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ABSTRACT 

In 1991 the Federal Government initiated the 
multiagency High Performance Computing and Communications program 
(HPCC) to further the development of U.S. supercomputer technology 
and high-speed computer network technology. This overview by the 
Congressional Budget Office (CBO) concentrates on obstacles that 
might prevent the growth of the high-performance computing and data 
communications industries. The market for supercomputers, relative to 
that of other technologies, is small. The main obstacle to the rise 
of large commercial markets for HPCC-deve loped technology is that 
cheaper workstations may preempt further growth of the supercomputer 
market as a whole* In addition, an economic inertia may occur, as 
conventional supercomputers, working well, become difficult to 
dislodge in the marketplace. The National Research and Educational 
Network (NREN) is central to the HPCC program. The ways in which 
Internet is becoming the core of a national data network promise well 
for HPCC in the future, but HPCC technology might be precluded from 
having a substantial effect on the current markets if demand for 
high-speed communications does not emerge as envisaged by HPCC 
leaders. Cost considerations and policy directions for HPCC are 
discussed* Five tables, six figures, and one box illustrate the 
discussion. Three appendixes discuss HPCC technology spinoffs and 
speed calculations. (SLD) 
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Preface 



The High Performance Computing and Communications (HPCC) pro- 
gram embodies many concerns regarding federal technology policy: the 
role of the federal government in promoting new industries, building in- 
frastructure, supporting joint federal-private efforts, and encouraging the 
transfer of technology. This report focuses on the first of these concerns-the 
federal role in promoting new industries* As requested by the Senate Commit- 
tee on Commerce, Science, and Transportation, the report concentrates on the 
obstacles-mainly on the demand side-that might prevent the high-per- 
formance computing and data communications industries from growing and 
using the technology being developed under the HPCC program. In keeping 
with the Congressional Budget Office's (CBO's) mandate to provide nonparti- 
san analysis, no recommendations are made. 

Philip Webre of CBO's Natural Resources and Commerce Division wrote 
this report under the supervision of Jan Paul Acton and Elliot Schwartz. 
Serdar Dine, then with CBO, provided research assistance in early stages of 
the project. The National Coordinating Office for High Performance Comput- 
ing and Communications coordinated Executive Branch agency comments on 
earlier drafts. The author wishes to thank Fiona Branton, Alan Buzacott, 
Deborah Clay-Mendez, Kenneth Flamm, Stephen Gould, Mark Grabowitz, 
Peter Gregory, Anthony Hearn, Robert Kelly, Paul Muzio, W. Edward 
Steinmueller, Richard Van Atta, and Joan Winston for their helpful comments 
on earlier drafts. 

Francis Pierce and Sherry Snyder edited the manuscript, with editorial 
assistance from Christian Spoor, and Donna Wood typed the many drafts. 
Martina Wojak-Piotrow prepared the report for publication. 



Robert D. Reischauer 
Director 
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Summary 



In 1991, the Administration and the 
Congress initiated the multiagency 
High Performance Computing and 
Communications (HPCC) program to further 
the development of U.S. supercomputer tech- 
nology and high-speed computer network 
technology. Although one reason for this leg- 
islation was to improve the performance of 
federal missions, an important consideration 
was the benefits such technology might yield 
for private industry. Such benefits can only 
be realized if the technology becomes widely 
used in industry-in short, if it is commercial- 
ized. 

Commercial success, however, is only one of 
several goals for HPCC. A full analysis of the 
program, which is not attempted in this study, 
would take into account how HPCC technol- 
ogy will affect federal missions* Even if it has 
only a small impact on commercial technol- 
ogies, the expenditures may be justified by its 
benefits for federal agencies. 



The High Performance 
Computing and 
Communications 
Program 

The technical goals of the High Performance 
Computing and Communications program are 
to create supercomputers capable of being 
scaled to a trillion mathematical operations 
per second and computer networks capable of 



transmitting a billion bits (a gigabit) of data 
per second. In each case, the goal is to achieve 
sustained performance of between one and 
three orders of magnitude better/than that of 
current technology. With this additional pow- 
er, federal agencies hope to be able to solve 
computational problems that have so far elud- 
ed solution in areas of federal interest such as 
changes in global climate, high energy phys- 
ics, and high-performance aircraft. These 
types of problems are referred to as "the grand 
challenges." 

The program is divided into four areas: 

o Supercomputer hardware, which focuses 
primarily on so-called scalable massively 
parallel supercomputers that are often 
composed of hundreds and thousands of in- 
dividual microprocessors; 

o Supercomputer software, which centers 
primarily on creating programming mod- 
els, tools, and applications for massively 
parallel supercomputers, which cannot use 
conventional supercomputer software; 

o Networking, which focuses on upgrading 
the interagency National Research and 
Educational Network and other agency 
networks, as well as on advanced network 
research and development (R&D); and 

o Basic research and advanced education for 
programmers. 

In many ways the HPCC program continues 
ongoing federal work in computer R&D, but 
with added emphasis. Thus, its budget has 
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two components: existing funds and additional 
funds. The program is intended to double the 
annual federal resources being devoted to the 
development of high-performance computers 
and computer networks over a five-year pe- 
riod, going from $600 million in fiscal year 
1992 to $1.2 billion in 1996. Funding over the 
five-year period is forecast to total $4.7 billion, 
of which $1.9 billion will be incremental to the 
previous levels of resources. 

Although HPCC is often described as a com- 
puter network R&D program, 80 percent of 
the new funds are for R&D involving areas 
other than networks. Supercomputer hard- 
ware and software are to receive over two- 
thirds of the incremental funds, while network 
R&D will receive one-fifth of the new monies; 
the remainder goes to basic research and edu- 
cation. Summary Table 1 presents the divi- 
sion of additional spending by program area. 



Summary Table 1. 

Incremental Funding for the HPCC Program. 
Fiscal Years 1992-1996, by Program Component 



Funding 



Component 


In Millions 
of Dollars 


Asa 
Percentage 
of Total 


High-Performance 
Computing Systems 


682 


36 


Advanced Software 
Technology and 
Algorithms 


662 


35 


National Research and 
Education Network 


390 


20 


Basic Research and 
Human Resources 3 


183 


JO 


Total 


1,917 


100 



SOURCE: Congressional Budget Office using data from Office 
of Science and Technology Policy, M The Federal High 
Performance Computing Program" (September 8, 
1989), p. 46. 



NOTES: HPCC = High Performance Computing and Commu- 
nications. 

Incremental funding is the additional money appro- 
priated to the HPCC agencies above the level the 
agencies were receiving at the start of the HPCC pro* 
gram for their activities in this area. Numbers may 
not add to totals because of rounding. 

a. In addition, 1 5 percent of each of the other three program 
components are to be devoted to this area. 



Supercomputer 
Technology and Markets 

The systems that now seem likely to be the 
first to develop the speeds sought by HPCC are 
massively parallel supercomputers. Conven- 
tional supercomputers are composed of a small 
number-usually less than 16--of very fast pro- 
cessing units. The massively parallel systems 
use a large number-as many as several hun- 
dred or thousand-of relatively slow processing 
units, all working in parallel on the same 
problem. 

HPCC is supporting research r.to a type of 
such supercomputers called seal ible, which 
means that the computers can h<s made more 
powerful by simply adding more computing 
nodes, unlike conventional supercomputers. 
The theoretical advantage of scalable archi- 
tectures is that software applications can be 
developed on smaller computers and used io 
run smaller data sets on smaller computers. 
However, if the models or data become too 
massive, the problem can be shifted to larger 
computers without having to rewrite the soft- 
ware. 

Most modern high-end supercomputers, in- 
cluding conventional supercomputers, are par- 
allel in the sense of having more than one pro- 
cessor, and the trend clearly is to increase the 
number. Where the technology strategies dif- 
fer between conventional and massively par- 
allel machines is in how fast to increase the 
number of processors over time. In order to 
achieve its speed goals, HPCC has gone with 
computer designers who would increase the 
number rapidly. 

Supercomputer Markets 

Because most supercomputers are used for re- 
search purposes, the market for them is small 
relative to other parts of the computer market. 
Only a couple of hundred systems are sold 
each year. By comparison, mainframe com- 
puter systems-the most similar type of system 
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physically, organizationally, and in cost-sell 
between 15,000 and 20,000 units a year. 
Overall, only 600 supercomputer systems are 
installed worldwide. According to the Depart- 
ment of Commerce, supercomputer sales to- 
taled $1.8 billion worldwide in 1992. 

Grov&h in the demand for supercomputers 
has slowed substantially in recent years. Al- 
though the market for them grew rapidly dur- 
ing most of the 1980s, the recent annual rate 
-of growth has been only 6 percent. Since many 
supercomputer uses are military applications, 
overall demand may be depressed for a num- 
ber of years. 

Supercomputer Technology 
Spinoffs 

Part of the reason for the focus on super- 
computer technology is the commonly held be- 
lief that supercomputer technology leads all 
computer technology. New technologies, it is 
often argued, will appear first in supercom- 
puters, where performance considerations out- 
weigh cost and other considerations. After an 
innovation has proved its worth, conventional 
computers can adapt it to their use. The policy 
corollary to this belief is that small invest- 
ments in supercomputer technology will pro- 
duce large benefits in all areas of the computer 
market. 

Although supercomputers and their high- 
performance predecessors originally led over- 
all computer technical development, this role 
has been reduced in the last 10 years. In fact, 
supercomputers played a minor role in many 
of the most important developments in com- 
puter technology in the 1980s. Most signifi- 
cantly, in the two central areas of computer 
technology development during the 1980s- 
computer architecture and integrated circuit 
technology-conventional supercomputer tech- 
nology was removed from the areas of rapid 
advance. The needs of personal computers and 
their high-powered cousins, the engineering 
workstations, drove most of the technology de- 
velopments in these areas. Although some 
technology has come from supercomputers, 



the major thrusts of computer technology de- 
velopment have recently been elsewhere. 

Nevertheless, in certain areas supercom- 
puters have been at the forefront of computer 
technology, most notably in software. As en- 
gineering workstations— high-performance 
versions of the personal computer-have be- 
come rapid enough to provide timely math- 
ematical solutions to engineering and scienti- 
fic problems, software originally written for 
supercomputers has been translated for work- 
stations. 

Future Trends in Technology 
Spinoff 

Unlike previous generations of supercomputer 
technology, the massively parallel supercom- 
puters, such as those being developed in 
HPCC, use the same components as the engi- 
neering workstations. In this circumstance, 
the likelihood of innovation in workstation 
technology arising first in the supercomputer 
market may increase, although at present the 
technology is flowing the other way. Indeed, 
the very existence of massively parallel super- 
computers is predicated upon the availability 
of high-performance technology from commer- 
cial workstations. At the computer component 
level, the technology flow is expected to con- 
tinue from workstations to parallel super- 
computers. 

Two of the likeliest major spinoffs from the 
massively parallel supercomputer to other 
types of computers do not involve components. 
Rather, the novel challenges HPCC is con- 
fronting in advance of the rest of the industry 
involve creating parallel paths in solving soft- 
ware problems and facilitating communica- 
tion between processors. When researchers 
have rewritten software applications to make 
them parallel for the massively parallel super- 
computer, they have discovered that the ap- 
plications also run better on conventional 
supercomputers. 

This effect-making software run more rap- 
idly by making the parallels implicit in most 
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problems more explicit-may apply more gen- 
erally. Similarly, discovering ways to en- 
hance communications among the supercom- 
puter's massive number of processors may be 
analogous to improving communications 
among conventional computers in computer 
networks. Transfer of these technical insights 
from supercomputer technology to conven- 
tional computer technology, however, may be 
limited by the differences in cost and perfor- 
mance objectives in the different markets. 

Obstacles to the Development of 
Large Commercial Markets for 
HPCC Supercomputer 
Technology 

The main obstacle to the rise of large commer- 
cial markets for HPCC-developed supercom- 
puter technology is that cheaper workstations 
may preempt further substantial growth of 
the supercomputer market as a whole. At 
present, an increasing share of commercial de- 
sign problems may be solved on workstations 
rather than on supercomputers. If the growth 
in the workstation market preempts further 
substantial growth in the supercomputer mar- 
ket, economic benefit from HPCC technology 
may not be sufficiently widespread to justify 
the large funds being devoted to it on purely 
commercial grounds. This situation may be 
analogous to the way the personal computer 
replaced the mainframe or minicomputer for 
many uses in the business world and reduced 
demand for larger business computers. 

The other obstacle to the widespread use of 
HPCC technology in the near term can best be 
described as economic inertia: conventional 
supercomputer hardware is good and contin- 
ues to improve, making conventional super- 
computers hard to displace in the market. 
Furthermore, close to 20 years' worth of soft- 
ware has been refined to run on that hard- 
ware. The difficulty of writing software for 
massively parallel supercomputers will make 
them slow to supplant conventional supercom- 
puters. Tests by the Department of Energy 
and the National Aeronautics and Space Ad- 



ministration suggest that currently available 
massively parallel supercomputers do not 
seem to be able to run most existing software 
as rapidly as the fastest conventional super- 
computers, despite their higher theoretical 
peak speeds. Nevertheless, measures of cost 
per unit of performance are favorable to mas- 
sively parallel supercomputers. 

Massively parallel computers currently oc- 
cupy a few different small markets, some with 
potential for significant growth. The market 
with the most potenti* 1 involves data-base 
management. Roughly half of corporate main- 
frame use involves data-base manipulation, 
such as spotting sales trends. Such problems 
are also well suited to parallel architectures. 
One major producer of massively parallel com- 
puters is already selling to this specialized 
market. (Although its computer is parallel, 
this is not, properly speaking, a supercomput- 
er as it lacks substantial number -crunching 
abilities.) 

Some massively parallel supercomputer 
manufacturers are interested in entering the 
data-base market. Data -base manipulation, 
however, generally does not require the num- 
ber crunching that is the strength of super- 
computers. Whether supercomputers can re- 
position themselves into this market is not 
clear. Massively parallel supercomputers also 
occupy a significant fraction of the supercom- 
puter market, currently supplementing con- 
ventional supercomputers in supercomputer 
centers. 



Computer Network 
Technology and Markets 

The National Research and Educational Net- 
work (NREN) is central to the HPCC program, 
both as part of the goal and as an enabling 
technology for other components of the pro- 
gram. By allowing supercomputers and other 
research assets of the federal government to 
be linked over a very rapid computer network, 
the program planners hope that the different 
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agencies will be able to bring their best tools 
to bear on solving the grand challenges. In ad- 
dition, NREN could demonstrate how other 
segments of society could use such power. 

The NREN component of HPCC has two 
major subcomponents: upgrading the inter- 
agency interim NREN, and research and de- 
velopment focused on computer networks of 1 
billion bits per second. The interagency in- 
terim NREN has several parts. The most com- 
monly discussed is the effort to bring the Na- 
tional Science Foundation's NSFNET up to 45 
million bits per second, which is largely com- 
pleted. NSF has begun the bidding process for 
the next upgrade. Less well known efforts in- 
volve bringing specialized data bases devel- 
oped by federal agencies on line to make them 
accessible from the NSFNET, and improving 
other federal agency networks. 

The research and development component 
of NREN largely focuses on so-called "gigabit 
test beds." In these test beds, industry teams 
and government researchers unite to develop 
and test different components, protocols, and 
other aspects of networking technology. As 
technology is developed it presumably will be 
incorporated into the construction of the in- 
terim NREN and vendor equipment. 

Computer Network Markets 

The United States has a very large and thriv- 
ing data communications market. According 
to the Department of Commerce, the world- 
wide market for computer network hardware 
and software exceeded sales of $8 billion in 
1991, much if not most of it provided by U.S. 
companies to clients in the United States. 

In addition, the Department of Commerce 
estimates that the U.S. market for value- 
added network services, including credit card 
validation and the like-perhaps the most com- 
mon single type of commercial network 
service- reached $6 billion in 1991. The mar- 
ket for another popular type of service, called 
outsourcing, in which one firm contracts with 
another to manage its computer network, is 



estimated to be in the $3.5 billion to $7 billion 
range annually. By contrast, the market in 
switched network services, comparable to 
switched voice telephone service, is still in its 
infancy. 

The Internet and Development of 
the Network Services Market 

The Interim NREN or Internet, which uses 
the existing NSFNET as its backbone, is a net- 
work of computer networks serving the educa- 
tional and research communities, all of which 
use the same computer protocol to communi- 
cate. The very rapid growth of traffic on 
Internet during its five years under the cur- 
rent contractor indicates that it is fulfilling a 
role in research and education (see Summary 
Figure 1). But its users are only a fraction of 
the potential numbers. A major question in 
upgrading Internet is whether delivering en- 
hanced service* * ^ its most sophisticated users 
is more valual « than broadening its usage by 
less sophisticated users. 

Because networks become more valuable as 
more people connect to them, Internet is be- 
coming the core of a nationwide data network 
for many of the key centers of science and 
technology in the United States. Not only uni- 
versities and research institutions, but also 
many technology companies have Internet 
connections directly or indirectly though com- 
mercial service providers. 

Obstacles to Developing a Large 
Commercial Market for HPCC 
Computer Network Technology 

HPCC technology might be precluded from 
having substantial effect on the current mar- 
ket for data communications if demand for 
high-speed data communication services does 
not emerge as rapidly or in the directions en- 
visaged by HPCC leaders. First, network us- 
ers may find costs to be too high because the 
price of one of the most important network 
components, leased private telephone lines, is 
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not dropping rapidly. Stagnant network costs 
could slow demand growth. Second, most us- 
ers may find their needs satisfied or mostly 
satisfied by current or emerging technologies. 

Costs of Private Network Lines. One cause 
of the proliferation of computers has been the 
rapid decline in computer prices. Prices of the 
metropolitan or regional area private tele- 
phone lines used by many computer networks 
are under the control of local telephone com- 
panies, which have a near-monopoly on them. 
The prices of these regulated lines, according 
to data filed before the Federal Communica- 
tions Commission, are falling by only a small 
percentage a year, which is insignificant in 
comparison with the price declines in most 
electronics hardware. Although potential 
competitors have entered the market for local 
area lines, they represent only a fraction of to- 
tal capacity. Despite commitments by local 
telephone companies to bring costs down by 



providing switched network services, their 
present commanding position in the leased 
private line business gives local telephone 
companies few incentives to spread switched 
network services aggressively, leaving most 
potential customers with expensive leased 
lines as their only option. 

The long-distance carriers seem to be fol- 
lowing the lead provided by the local tele- 
phone companies in setting short-distance pri- 
vate line prices. Although the prices posted 
with the Federal Communications Commis- 
sion for private lines longer than 200 miles 
have been declining since 1990, the prices of 
leased private lines shorter than 100 miles 
have been rising. Thus, the average posted 
price of a private 1,500,000 bit-per-second 
leased line provided by the major long dis- 
tance carriers roughly the distance between 
New York and Chicago (700 miles) has been 
falling roughly 13 percent a year since 1990, 



Summary Figure 1. 

History of Internet Traffic, 1988-1993 

Millions of Packets of Computer Information 
35.000 I 




July January January January January January 

1988 1989 1990 1991 1992 1993 

SOURCE: Congressional Budget Office from data provided by Merit/NSFNET, Ann Arbor, Michigan. 
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while the price of the same capacity line 75 
miles long has been rising by 7 percent a year 
since 1990. (The long-distance carriers also 
provide time and quantity discounts, so no sin- 
gle user may face precisely these prices.) Such 
price increases may affect the decisions of 
small and medium-sized regional businesses, 
which are crucial in a growing market. 

By contrast, prices of most other compo- 
nents of computer networks are falling. Con- 
sequently, overall computer network prices 
are still coming down. As prices of other net- 
work components fall, the prices of the leased 
lines will come to represent a larger fraction 
at the whole network, which may slow the 
overall decline in network costs and slow the 
growth in demand for network services. The 
rapid rise in the number of computers and lo- 
cal area networks for computers, however, 
may serve to increase the demand for network 
services, even if prices do not fall. 

Trade-Offs Between Cost and Perfor- 
mance. Above a certain technological level, 
computer network users may find little advan- 
tage in higher performance speeds. The 
NSFNET switching facilities have been up- 
graded from 1.5 million bits per second to pro- 
vide individual circuits capable of carrying 45 
million bits per second. This new service will 
make a difference in most current applica- 
tions. Above this level, however, networks 
reach a point of diminishing returns and ex- 
pansion from 45 million bits per second to 1 
billion bits per second may not create notice- 
able benefits for the vast majority of users who 
concentrate on electronic mail and simple file 
transfers. Without new applications to justify 
the cost, a mass market in such services may 
not develop. 



Policy Directions 

The Computer Systems Policy Project, a group 
representing U.S. computer producers, has ar- 



gued in their evaluation of HPCC that the 
computing problems the program intends to 
address, the so-called grand challenges, are 
too distant from the problems of daily life. In 
their view, the program does not effectively 
demonstrate ways in which high-performance 
computer networks could actually help people. 

In response to these arguments, the Con- 
gress has been considering legislation to ex- 
pand the network component of HPCC to ad- 
dress these problems. One approach would ex- 
pand HPCC to create applications in four dis- 
tinct areas. To pay for these additional pro- 
grams, the Congress would authorize an addi- 
tional $1.0 billion to $1.6 billion over the next 
five years, targeted on four areas: medicine, 
education, manufacturing, and libraries. 

o In medicine, the bills would direct the Na- 
tional Library of Medicine to develop net- 
work applications for communicating 
medical images, such as X-rays and CAT 
scans, by computer network; build test-bed 
networks to link hospitals and other medi- 
cal centers for the sharing of data and 
records; and help provide long-distance 
medical care. 

o In education, the National Science Foun- 
dation would be authorized to develop pilot 
projects to connect U.S. elementary and 
secondary schools to Internet, including 
generating software and training materi- 
als. 

o In manufacturing, the National Institute 
of Standards and Technology would 
develop and transfer electronically net- 
worked manufacturing applications, in- 
cluding development of standards. 

o Both the National Science Foundation and 
the National Aeronautics and Space Ad- 
ministration would be made responsible 
for developing prototype digital libraries 
and the associated technology, including, 
in the case of the National Aeronautics 
and Space Administration, making spe- 
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cialized government satellite data available 
over Internet. 

Underlying the proposed expansion is an 
unresolved tension in the direction of HPCC. 
Is HPCC ultimately concerned with providing 
networks for the federal missions that need to 
link high-performance computers, or is its 
main objective to develop technology to make 
ubiquitous computer networks a reality? The 
former implies high-speed links between im- 
portant national research centers, while the 
latter emphasizes an inexpensive and easy-to- 
use network available to a wider public. 

Until now, the fact that parts of the HPCC 
budget were dispersed among the "discretion- 
ary spending" portions of several agency bud- 
gets mitigated this conflict among objectives. 
But given the cuts in discretionary spending 
mandated by the Budget Enforcement Act of 
1990, policymakers may have to decide which 
aspects of HPCC are most critical. Since the 
agencies centrally involved in HPCC--the Na- 
tional Science Foundation and National Aero- 
nautics and Space Administration-experi- 
enced real declines in their budget authority 
in 1993, they will have to make internal deci- 
sions as to which of the different components 
of HPCC will take precedence. 



Conclusions 

Most of the barriers to the commercialization 
of HPCC technology discussed in this report 
may be factors limiting the demand for these 
new technologies. New technologies often 
founder on the demand side, when the benefits 
they offer seem not to be worth the added ex- 
pense for most potential users. Commercial 
demand is, of course, not the only reason for 
pursuing these technologies. In many cases, 
government agencies can use the capabilities 
of high-performance computing or commu- 
nications -indeed, that is one of the primary 
goals of HPCC. In the short term, however, 
agency missions often conflict with commer- 
cial requirements. 

The different elements of HPCC vary in 
their economic potential. Most obviously, the 
graduate students trained under the human 
resource programs are likely to find jobs in 
teaching and in industry, where they will be 
needed to educate the next generation of com- 
puter programmers and to write commercial 
computer programs. Other parts of the HPCC 
program may not have as smooth a road. 
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The federal government has fostered 
the development of computer technol- 
ogy since World War UA At the fron- 
tier of today's technology are high-perfor- 
mance computers and the communications 
networks that would allow more people to use 
them. The Administration and the Congress 
have taken existing programs, provided addi- 
tional funds, and molded a multiagency pro- 
gram for research into and early development 
of high-performance computers, the software 
they use, and the networks that link them. 

The High-Performance Computing Act of 
1991 established the High Performance Com- 
puting and Communications (HPCC) program 
to promote U.S. technological leadership in 
high-performance computing and data com- 
munications. In programmatic terms, that 
goal means developing computer architec- 
tures-the design of a computer's functional 
operations and logic system-that can perform 
up to 1 trillion mathematical operations per 
second, and computer networks that enable 
users to transmit or receive up to 1 billion bits 
of computer data per second. Concomitant 
with this will be the development of software 
applications and the training of computer sci- 
entists and programmers who will use the new 
technologies. 

The types of problems that require this level 
of computing power are referred to as the 



l . For a history of federal government involvement in com- 
puter technology, see Kenneth Flamm, Creating the 
Computer: Government, Industry and High Technology 
(Washington, DC: Brookings Institution, 1986). 



"grand challenges. 0 These grand challenges 
include scientific problems such as studying 
ozone depletion and air pollution and model- 
ing the ocean. But they also include potential 
industrial applications such as designing 
drugs (rather than discovering them) and 
modeling industrial chemical processes. Their 
common ground is that the solutions to these 
problems should be both demanding on com- 
puter resources and valuable to the nation. 

The program's mission, however, is not sim- 
ply to devise the fastest computers and com- 
puter networks, but also to ensure that the re- 
sulting technology is disseminated widely and 
applied to national needs, including those re- 
lated to economic competitiveness, national 
defense, education, and the environment. A 
key goal of the program is to have the technol- 
ogy become an integral part of the problem- 
solving process in U.S. firms, thus improving 
U.S. productivity and competitiveness. Faster 
and cheaper computer power could help design 
teams in their search for new drugs, airplane 
designs, efficient and nonpolluting automobile 
engines, and so on. Program managers be- 
lieve that the improvements derived from this 
new computer technology could allow U.S. 
firms to compete more effectively in world 
markets. 

The HPCC program will clearly benefit the 
scientific and research communities. But will 
it have a major effect on the larger computing 
market beyond this initial user group? This 
question would not be as central if HPCC were 
solely a science program. The intent of the en- 
abling legislation, however, is that HPCC will 
also help industry to create and sell better 
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computers and data communications equip- 
ment. Meeting the first goal-building a sci- 
entific instrument to be used by federal 
agencies-will be relatively easier to accom- 
plish and provides a familiar role for the gov- 
ernment. Meeting the second goal will be 
more difficult; past federal efforts in this direc- 
tion have had mixed success. 

This report focuses on potential obstacles 
facing HPCC program managers in meeting 
the second goal, particularly on economic and 
institutional barriers that may hamper the 
creation of large commercial markets for the 
technology developed in the HPCC program. 
Most of the barriers discussed in this report re- 
late to the demand for this new technology. It 
is on the demand side, in fact, that many new 
technologies founder: potential clients simply 
do not consider the advantages provided by 
the new product or services worth the cost and 
effort of switching from their current way of 
doing things 2 Although there will also be 
challenges on the supply side, HPCC is ad- 
dressing them directly through its research 
and development (R&D) component. This re- 
port assumes that the program can produce 
the desired technology. The question it seeks 
to answer is, What happens when the R&D is 
successful? 



Public Purposes for 
Funding the HPCC 
Program 

The federal government is funding the HPCC 
program for two general reasons. First, such 
technology may help federal agencies to ac- 
complish some of their missions more effec- 
tively. Second, such funding is part of the 
overall federal role of funding R&D. These ra- 
tionales, however, are shifting and are subject 
to some qualification. 



2. Steven Schnaars, Megamistakes: Forecasting and the 
Myth of Rapid Technological Change (New York: Free 
Press, 1989). 



The principal federal uses of supercom- 
puters have been in the design of nuclear 
weapons and in intelligence. With the end of 
the Cold War, the need for new nuclear weap- 
ons has been substantially reduced. The intel- 
ligence function, especially the electronic sur- 
veillance that required supercomputers, has 
also been affected, though less drastically. In 
addition, supercomputers are used in energy, 
environmental, and space missions, but these 
have traditionally been secondary uses. Fed- 
eral activity in the fields of national security 
and pure science is outside the bounds of this 
study, which focuses on the commercial as- 
pects of HPCC technology. 

Economists use two general arguments to 
justify financing R&D programs for technol- 
ogies that have potential commercial uses. 
The first is the well-known tendency of private 
firms to underinvest in R&D. Economists gen- 
erally argue that private firms, left to their 
own devices, tend to underfund R&D largely 
because the innovating firm is unable to cap- 
ture all the benefits from its R&D investment. 

The second argument invokes a traditional 
governmental role in the production of infra- 
structure. As computers become ubiquitous, 
their ability to communicate through net- 
works will benefit more and more of the econo- 
my, just as the proliferation of telephones ear- 
ly in this century made telecommunications 
an essential part of the U.S. economy. The 
role of the federal government in helping to 
create that infrastructure-through R&D, 
demonstrations, regulation, and setting of 
standards-can be significant. (Questions of 
how the computer network infrastructure will 
be planned, financed, and provided are beyond 
the scope of this study.) 

Governmental support for HPCC is also 
driven by the perception that the development 
of computer technology has been good for the 
country and will continue to be so. Because 
the federal government played a significant 
role in the past development of the computer 
industry, many people believe that it can do so 
in the future. 
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Commercialization Defined 

In this study, the term "commercialization of 
HPCC technology" refers to the development 
of substantial nongovernmental markets for 
products incorporating technology developed 
under the HPCC program. A technology de- 
veloped for the HPCC program would be com- 
mercialized if it were sold directly in large 
numbers or if it were incorporated into various 
products that were then sold in significant 
quantities. 

The HPCC program leadership takes a less 
rigorous view of commercialization: it argues 
that if a contractor to an HPCC agency devel- 
ops technology for the government, the tech- 
nology is commercial because it is in the hands 
of a private party. Because most of the R&D 
performed on hardware for supercomputers or 
networks is being performed in the laborato- 
ries of private contractors, the technology is by 
this definition commercial, and the HPCC pro- 
gram has therefore succeeded in commercial- 
izing its technology. 

The problem with this definition is that it 
ignores half of all markets-namely buyers. 
Numerous technologies have been sold by con- 
tractors to the government, but have had vir- 
tually no commercial buyers. The National 
Aeronautics and Space Administration's con- 
tractors have failed to sell a single space shut- 
tle to nongovernmental buyers, for example. 
Similarly, the Department of Energy's con- 
tractors are not selling a lot of synchrotrons, 
although the expertise to build them is surely 
in private hands. Of course, weapons first de- 
veloped for the Department of Defense have 
been sold worldwide, but usually to other gov- 
ernments. 

To judge the effect of the HPCC program on 
the development of computer and data com- 
munications markets, which is the stated in- 
tent of the legislation, the appropriate ana- 
lytic framework must involve private sales, 
not just private supplies. In the case of super- 
computers and computer networks, however, 
this definition may be too narrow. In both 
these markets, federal buyers represent a 



large percentage of all buyers, independent of 
the HPCC program. For this reason, and also 
because many statistical sources may not 
break out the relevant data into governmental 
and nongovernmental sales, the definitions 
used in this study have been broadened to in- 
clude all sales-governmental and commercial. 

The HPCC Program as an 
Investment 

Funding the HPCC program will be a substan- 
tial investment and should be undertaken on- 
ly if the economic rewards are likely to provide 
an acceptable rate of return to society as a 
whole. Improving computer technology itself 
is not a sufficient rationale-computer technol- 
ogy is already improving rapidly. Rather, the 
HPCC program has to move computer technol- 
ogy ahead more rapidly than would otherwise 
occur or in directions in which it would not 
otherwise move. 

On previous occasions, federal agencies 
committed themselves to speeding up elec- 
tronic technology only to discover that com- 
mercial electronic technology was moving 
even more rapidly .3 Improving technology is 
not enough; the HPCC program must have a 
very good chance of substantially advancing it 
more rapidly than would otherwise occur. 

Similarly, the commercial benefits should 
be in proportion to the size of the investment. 
A federal program that spends several billion 
dollars to help create a market of a few hun- 
dred million dollars a year may not provide a 
substantial social rate of return to the tax- 
payers. (On an annual basis, a few hundred 
million dollars would normally be a reason- 
able return on a few billion dollars, but these 
few hundred million dollars of sales would re- 
quire substantially more than just the federal 



3. For a discussion of how civilian semiconductor technol- 
ogy usually outpaces that of the military despite special 
initiatives, see Anna Slomovic, "An Analysis of Military 
and Commercial Microelectronics: Has DoD's R&D 
Funding Had the Desired Effect? 1 (Ph.D. dissertation, 
RAND Graduate School, Santa Monica, California. 
199U 
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investment. They would also require addi- 
tional product development by private inves- 
tors, as well as investment in manufacturing 
the devices. The return on HPCC would be net 
of the return on these subsequent invest- 
ments.)* 



The HPCC and Previous 
Federal Computer R&D 
Programs 

Many economic studies of federal R&D pro- 
grams have found that, unlike private R&D 
spending, most federal R&D funding does not 
provide a substantial economic rate of return fi 
(Most federal R&D is mission-related and does 
not result in increased economic output as 
measured by typical indexes.) By contrast, 
federal efforts in computer R&D have enjoyed 
many technical and economic successes. 

In the periods when the federal government 
had many of its largest successes in computer 
R&D, the computer industry was in its in- 
fancy. Now, however, that industry is very 
large and quite sophisticated. U.S. producers 
of computers, software, and related services 
sold roughly $260 billion worth of goods and 
services worldwide in 1989.6 This amount 
compares with less than $5 billion in 1960 and 



4. See Congressional Budget Office, "A Review of Edwin 
Mansfield's Estimate of the Rate of Return from Aca- 
demic Research and Its Relevance to the Federal Budget 
Process" CBO StaffMemorandum (April 1993), for a dis- 
cussion of rates of return on R&D. 

5. For a review of this literature, see Congressional Budget 
Office, How Federal Spending for Infrastructure and 
Other Public Investments Affects the Economy (June 
1991), Chapter IV. 

6. CBEMA Industry Marketing Statistics Committee. The 
Information Technology Industry Data Handbook, 1960- 
2001 (Washington, D.C.: Computer and Business Equip- 
ment Manufacturers Association, 1991), p. 9. Other 
sources have a smaller, but still large, estimate of the 
U.S. computer industry. For example, McKinsey and 
Company, the management consultants, estimate 1992 
worldwide sales at $208 billion. See McKinsey and Com- 
pany, The 1992 Report on the Computer Industry" (San 
Francisco, Calif., 1992), p. 2-13. 



$20 billion in 1970. Large, mature industries 
are likely to be more difficult to stimulate 
technologically than small, developing ones. 

The federal role in computer R&D has been 
decreasing for several decades. In the 1960s, 
federal agencies spent between a quarter and 
a half of what private firms spent on R&D in 
the computer industry.? But in the late 1970s 
and 1980s, federal agencies did not keep up 
with the growth in private R&D in the com- 
puter industry: spending by federal agencies 
was between 10 percent and 15 percent of the 
private level. 8 The absolute levels of the pri- 
vate R&D efforts rose throughout this period. 
The National Science Foundation estimates 
that U.S. computer manufacturers alone spent 
roughly $10.5 billion of their own funds in 
1989— the last year for which data are 
available- on R&D for computers, compo- 
nents, and software.9 By contrast, in 1975, 
private firms spent $1.7 billion on such R&D. 
Given the reduced share of federal R&D, as 
well as the increased level of private R&D, one 
might assume that the federal role in promot- 
ing technological innovation was also reduced. 

Most important, the computer and data 
communications industries have become much 



7. Before 1972, the National Science Foundation had no 
separate R&D category for the computer industry. 
Moreover, the NSF has not published federal spending 
for R&D in the computer industry for reasons of confi- 
dentiality since 1979. Thus, this analysis is based on the 
machinery industry, of which the computer industry is 
the largest component. The R&D and output statistics of 
the machinery industry are dominated by the computer 
industry, according to the National Science Board, Sci- 
ence and Engineering Indicators- 199 1 (1991), p. 424. 
See Science Indicators for previous years. See also Na- 
tional Science Foundation, "Research and Development 
in Industry/* various years. Using these sources, CBO 
was able to obtain a fairly consistent estimate of govern- 
ment and company R&D spending in the machinery in- 
dustry and, to a less extent, the computer industry. 

8. As noted, these figures are for the larger machinery in- 
dustry; the computer industry R&D figures were prob- 
ably closer throughout the entire period, while exhibit- 
ing the same downward treH. 

9. National Science Board, Science and Engineering Indi- 
cators-1991, p. 424. Software producers (federal and 
private) spent an additional $2.7 billion in 1989. See 
Melissa Pollak, "Research and Development in the Ser- 
vice Sector" The Service Economy (Washington, D.C.: 
Coalition of Service Industries, July 1991), p. 4. 
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more competitive during the past decade. 
Many different companies compete for a rela- 
tively small part of this large market, and 
many federal R&D and regulatory programs 
have helped make this industry highly com- 
petitive. As a result, the pressures on firms in 
the industry are now quite different than 
when the computer industry was dominated 
by one company and data communications by 
another. In this new, more competitive mar- 
ket, the pressures on firms to introduce new 
technology are much greater than previously. 
Consequently, federal policies to stimulate in- 
novation are less likely to play an important 
role overall. 



Alternative Strategies for 
the HPCC Program 

The strategy of the HPCC program for com- 
mercialization is consistent with a traditional 
federal approach. It aims to develop technol- 
ogy to fulfill the federal mission by using a 
mix of in-house expertise and outside contrac- 
tors. Like previous federal programs, it em- 
phasizes a single aspect of the technology--in 
HPCC's case, speed. Demonstration projects 
and other explicit efforts to transfer and com- 
mercialize the technology account for only a 
fraction of the resources devoted to the project. 

Development of Everyday 
Applications 

The Computer Systems Policy Project (CSPP), 
an industry organization representing the 
chief executive officers of major U.S. producers 
of computer systems, presented a different 
strategy for HPCC. Its recommendations for 
the network portion of the project included 
suggestions to "ensure the HPCC serves as a 
stepping stone to broader future information 

infrastructure This will require expanding 

activities under the NREN [National Re- 



search and Education Network] component to 
include research and development on the tech- 
nologies needed to support broadly accessible 
and affordable networks."™ 

CSPP's specific concerns focused not so 
much on computer power or network speed, 
but on those aspects that might impede the 
spread of network technology. These aspects 
include security and privacy of data and indi- 
viduals and issues of intellectual property 
rights, standards, and regulation. CSPP 
placed a great deal of emphasis on ensuring 
network compatibility and the broadest possi- 
ble access to the system. 

The technical choices the HPCC program is 
making to serve the interests of federal com- 
putational science researchers may not trans- 
late into features that the majority of commer- 
cial computer network users will find desir- 
able. Although HPCC planners have ex- 
pressed concern about the solution of a broad 
range of problems, including some that could 
contribute substantially to U.S. welfare, CSPP 
contends the initiative would directly contri- 
bute little to the lives of most citizens. The 
grand challenges are, in some sense, too 
grand. 

CSPP would prefer to see more everyday ap- 
plications of high-performance computing. 11 
These uses would include giving broader ac- 
cess to electronic data bases, enhancing educa- 
tion through electronic field trips, and improv- 
ing the life of housebound citizens. In the 
manufacturing arena, CSPP places as much 
emphasis on the integrative functions of data 
communications as on the "gee-whiz" aspects 
of designing products on computers. In this 
view, the HPCC program should not just aim 
to develop trillion-operation supercomputers 



10. Computer Systems Policy Project, "Expanding the Vi- 
sion of High Performance Computing and Communica- 
tions: Linking America for the Future" (Washington. 
DC, December 3, 1991). p. II. 

11. Computer Systems Policy Project, "Perspectives on U.S. 
Technology and Trade Policy: The CSPP Agenda for the 
103rd Congress" (Washington, D.C., October X, X992), p. 
8. 
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that talk to each other on billion-bit networks. 
Rather, it should include a wide array of com- 
puter resources, usable in a wide array of cir- 
cumstances, and applicable to a wider array of 
national needs than originally envisioned. 

In keeping with its alternative vision of the 
HPCC program, CSPP has recommended re- 
arranging the program's budgetary priorities. 
Whereas most of the current funding focuses 
on a single design of supercomputer, CSPP 
would like to see a broader range of hardware 
and software configurations. Second, the 
HPCC program's software budget contains 
funds to purchase a great deal of hardware, 
while CSPP would emphasize more software 
funding. Third, it would expand the compo- 
nents for developing basic research and hu- 
man resources. Finally, CSPP would shift the 
program's balance from advancing technology 
to applying it. 

Although the HPCC program is commonly 
viewed as a network project, only 20 percent of 
the new funds for HPCC is for networks. 
CSPP believes that the network component of 
HPCC has the greatest potential and sees its 
low share of funding as an example of the im- 
balance in the HPCC budget. 

In short, rather than being concerned about 
the program's meeting the grand challenges of 
the original HPCC documents, the CSPP is in- 
terested in ensuring that the technology has 
potential commercial use. Unless the new net- 
work technology addresses the concerns of 
their commercial customers, who represent 
the largest market share of demand for com- 
puter network goods and services, CSPP mem- 
bers feel it will not meet their needs. 

Development of Self-Sastaining 
Markets 

To a degree, CSPP's vision contains contradic- 
tory notions. The earliest users of advanced 
computer technology are likely to be involved 
in high-value activities, typically in business 
and medicine or in government, since only 



those activities can pay the costs high-per- 
formance systems usually involve. Electronic 
field trips for schools or the disabled, as envi- 
sioned by CSPP, will not be among the early 
uses of HPCC technology. Ordinary citizens 
are most likely to encounter such technology 
when they purchase a good or service that in- 
corporates it-for example, medical records 
and images that are stored and transmitted 
electronically. 

Indeed, HPCC technology is most likely to 
be commercially successful if it can first de- 
velop a broadly based market of high-value re- 
sources to store, distribute, and manipulate 
specialized information. By providing special- 
ized information equipment and other re- 
sources to organizations willing to pay for 
them, it may enable CSPP members and other 
firms to bring down costs to the point that 
such equipment and resources become more 
widely used. 



Competing Views of 
Commercialization 

The differences in policy strategies discussed 
above largely result from divergent views of 
the process of technological change and the 
role of the government in it. 12 One view fo- 
cuses on developing advanced technology, and 
the other on diffusing that technology. 

In the first view, the federal government de- 
velops the technology for its own needs and 
leaves its further application to others. This 
view recognizes that there are many institu- 
tional obstacles to creating a market for new 
technology and that such market development 
is inherently risky. A basic tenet of this view 
is that, other than in a few areas such as set- 
ting of standards, the federal government can 



12. For a more detailed discussion of different views of 
commercialization, see Congressional Budget Office. Us- 
ing R&D Consortia for Commercial Innovation: 
SEMATECH, X-ray Lithography, and High- Resolution 
Systems (July 1990). pp. 5-10. 
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do little to overcome these obstacles and 
should leave their solution to the private sec- 
tor, which has profit as the motivation for cre- 
ating markets and overcoming obstacles. 

In the case of HPCC, federal agencies will 
develop, or help industry to develop, very fast 
computers and networks and software tools for 
application to agency missions, including ba- 
sic university research. Their diffusion to the 
rest of the economy, however, is left to the 
computer industry and telecommunications 
providers. 

In the other vision of * achnological change, 
the federal government has a role to play in 
overcoming obstacles that could keep technol- 
ogy from spreading throughout the economy. 
The government might help to develop specific 
uses that could speed the spread of technology 
broadly into the economy- -for example, devel- 
oping less expensive, rather than faster, data 
communications technology, or making soft- 
ware easier to use. In this view, developing 
new markets and infrastructure is as filled 
with risk, uncertainty, and socially beneficial 
spillovers as is developing new technology. 
Given the costs, which are concentrated and 
large, and the social benefits, which are dif- 
fuse but in the aggregate can be greater than 
the costs, the federal government may in this 
view be uniquely positioned to sustain the in- 
vestment necessary to spread new technology 
throughout the economy. 

The federal track record in bringing new 
computer technology to market is mixed, how- 
ever. The Advanced Research Projects Agency 
(ARPA) has certainly had much success in 
many areas of computing and electronics. 13 
But it also has a 20-year history of promoting 



parallel high-performance computers, the 
market success of which is still quite limited 
(under $300 million in yearly sales). Even 
with some of its successful projects, such as 
ARPANET-the first computer network- 
ARPA has sometimes had to continue support 
for years beyond its original intent before a 
self-sustaining community of users devel- 
oped. 14 

The Comparative Advantage of 
the Government 

One trade-off that the Congress and the Ad- 
ministration face in the different facets of 
HPCC is the choice between pursuing near- 
term commercial implementation of HPCC 
technology and emphasizing the highest tech- 
nical performance. For example, federal re- 
searchers stand at a comparative advantage 
in basic research on new ways of conceptualiz- 
ing computer software. The reward system for 
federal R&D is based on technical excellence, 
often through peer review. By contrast, com- 
mercial providers of software achieve success- 
that is, profits-by being able to deliver soft- 
ware that addresses users' immediate con- 
cerns. Thus, although providing the next gen- 
eration of hardware or software may ensure 
more commercial success for the technology 
developed under the HPCC program, federal 
researchers may not be in the best position to 
do that. 15 

Conversely, however, because HPCC pro- 
gram-sponsored supercomputers lack a large 
supply of commercial software, the sales of 
such computers are limited mainly to aca- 
demic and government R&D centers. If the 
community of users is not sufficiently devel- 
oped, the loss of federal backing could hurt the 



13. The Defense Advanced Research Projects Agency 
(DARPA) recently changed its name to Advanced Re- 
search Projects Agency (ARPA), the name it was known 
by before 1972. For the role of ARPA in the development 
of computer technologies, see Richard Van Atta, Sidney 
Reed, and Seymour Deitchman, DARPA Technical Ac- 
complishments: A Historical Review of Selected DARPA 
Projects, Volumes I, Hand ///(Alexandria, Va.: Institute 
for Defense Analysis, February 1990). especially Chap- 
ters 18 through 23 of Volume I and Chapters 13-19 of 
Volume tt. 
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14. Advanced Research Projects Agency, "The Advanced Re- 
search Projects Agency, 1958-1974" (produced under 
contract by Richard J. Barber Associates, Washington, 
D.C., December 1975), pp. DC-57 through EC-59. 

15. For a similar argument with regard to supercomputers, 
see Willie Schatz. "DARPA Riga the Playing Field," Up- 
side (May 1993), pp. 38*48. 
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efforts of private companies to create a market 
for their products. 

This pattern of federal comparative advan- 
tage can be seen in other computer R&D ef- 
forts. In many of its more recent successes in 
high-performance computing, ARPA paid for 
university research to build a prototype and 
then left it to private initiative to bring this to 
market. University researchers operating on 
ARPA funds originally designed much of the 
technology underlying the specialized graph- 
ics, software, integrated circuits, and high- 
performance computers now commonly used 
in scientific and engineering computing cir- 
cles. 16 Without ARPA funding, it is fair to ar- 
gue, high-performance computing would prob- 
ably be much less developed than it is today. 



16. Van Atta. Reed, and Deitchman. DARPA Technical Ac- 
complishments, Chapter 17 of Volume II. 



But ARPA did its work without being directly 
concerned with the sales of the resulting prod- 
uct. 

Program Risks 

By trying to be all things to all people, the 
HPCC program might lose its focus and dissi- 
pate its resources without effect. By focusing 
on one fairly narrow range of computing 
needs, the program may be more likely to ad- 
vance the technology. The risk is that the 
technology will be irrelevant. 

No strategy the HPCC planners choose will 
be without risk. On the one hand, federal 
R&D could be too near the marketplace, dis- 
torting choices and preempting private ac- 
tions. On the other hand, the HPCC program 
could abandon such R&D prematurely to focus 
only on longer-term technology, leaving this 
technology an orphan, and perhaps stunting 
the growth of this market. 
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Chapter Two 



The HPCC Program 



Policymakers designed the High Per- 
formance Computing and Communica- 
tions program to improve the technol- 
ogy of supercomputers and data communica- 
tions. This program focuses on hardware and 
softwiju a for supercomputers, data communi- 
cations systems, and basic research and train- 
ing. Several principal federal agencies are in- 
volved in developing different aspects of the 
technology. 



The HPCC Budget 

The HPCC program is essentially a continu- 
ation of ongoing federal work in the area of 
computer research and development with ad- 
ditional resources and more emphasis on co- 
ordinating federal efforts. Thu°, the HPCC 
budget includes both existing and incremental 
funds. 



The 1892 Plan 

The program is intended to double the federal 
resources being devoted annually to develop- 
ing high-performance computers and com- 
puter networks over the 1992-1996 period. 
The original funding request for 1992 was 
$640 million, rising to $1.2 billion in 1996. 
Funding over the five years would total $4.7 
billion (see Table 1). 

Since 1992, two factors have intervened to 
change the budget, though not substantially. 
First, other existing programs have been in- 



cluded in the HPCC tallies. For instance, the 
original 1992 plan included only $17 million 
for the National Library of Medicine, but the 
1993 request included other parts of the Na- 
tional Institutes of Health, bringing the total 
to $45 million. The National Oceanic and At- 
mospheric Administration (NOAA) also in- 
creased its participation. The National Secu- 
rity Agency joined the HPCC program, adding 
$22 million to the total. 

The second set of changes in the plan have 
resulted from policy decisions to change fund- 
ing. For example, to allow for growth in fund- 
ing for the space station within a constrained 
overall budget, the National Aeronautics and 
Space Administration (NASA) reduced its 
HPCC research and development for 1993 by 
$26 million. The Advanced Research Projects 
Agency has cut its funding by $8 million below 
the plan. The most significant change, how- 
ever, has been in the National Science Foun- 
dation^ appropriations for research and re- 
lated activities for 1993, in which its HPCC 
activities received only a 12 percent increase 
rather than the planned increase of 23 per- 
cent. 

Despite these changes, no new baseline bud- 
get exists for HPCC as a whole. The agencies 
regard their five-year budget projections for 
the program as confidential. 

Incremental Funding 

Establishing a firm estimate of the costs of the 
different components over the duration of the 
program is difficult. As noted above, this ini- 
tiative includes many ongoing programs, some 
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new ones, and additional resources that have 
been diverted to existing programs. Agencies 
may choose which of their programs to include 
in the HPCC. Specific agency participation is 
reflected in various pieces of authorizing legis- 
lation, if at all. Consequently, there is no sin- 
gle complete statement of the HPCC budget. 

Details on the incremental funding that 
was included in the 1992 plan are presented 
by program area, not by agency. Not all pro- 
gram components received equally increased 
funding in the original plan. Table 2 presents 
the level of additional funding discussed in the 
HPCC planning documents. 

Incremental funds totaled $1.9 billion over 
five years. The programs for High-Perfor- 
mance Computing Systems (HPCS) and Ad- 
vanced Software Technology and Algorithms 
(AST A) each received slightly more than one- 
third of the funds. The National Research and 
Education Network accounted for 20 percent, 
and Basic Research and Human Resources for 
the rest. 



High-Performance 
Computing Systems 

The goal of the HPCC program with regard to 
computer hardware is to develop computer ar- 
chitectures that can achieve a trillion math- 
ematical operations per second-two or three 
orders of magnitude above current perfor- 
mance levels. The systems that seem most 
likely to develop this power first are called 
massively parallel supercomputers. Conven- 
tional supercomputers have a small number- 
usually fewer than 16-of very fast processing 
units working on a problem. In contrast, the 
massively parallel systems can have several 
hundred or even several thousand slower pro- 
cessing units. 

What distinguishes the scalable architec- 
tures that the HPCC program is concentrating 
on from other massively parallel supercom- 
puters is the idea that the same basic com- 
puter architecture should be able to be scaled 



Table 1. 

Original Five-Year Budget Plan for the HPCC Program 
(Budget authority in millions of dollars, by fiscal year) 



Agency 


1992 


1993 


1994 


1995 


1996 


1992-1996 


Advanced Research Projects Agency 


232 


283 


353 


399 


447 


1.714 


Department of Energy 


93 


110 


138 


157 


168 


666 


Environmental Protection Agency 


5 


5 


5 


5 


5 


25 


National Aeronautics and Space Administration 


72 


107 


134 


151 


145 


609 


National Library of Medicine 


17 


17 


17 


17 


17 


85 


National Institute of Standards and Technology 


3 


3 


3 


3 


3 


15 


National Science Foundation 


213 


262 


305 


354 


413 


1,547 


National Oceanic and Atmospheric Administration 


_2 


_3 


_3 


3 


3 


14 


Total 


638 


790 


958 


1,089 


1,201 


4,676 



SOURCE : Congressional Budget Office using data from the Office of Management and Budget. 



NOTE: Includes incremental funding. 
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Table 2. 

Incremental Funding for the HPCC Program, 
Fiscal Years 1992-1996, by Program Component 



Funding 



Component 


In Millinnc 

II 1 IVI IIIIUI !> 

of Dollars 


Asa 

PormntAno 

of Total 


High-Performance 
Computing Systems 


682 


36 


Advanced Software 
Technology and 
Algorithms 


662 


35 


National Research and 
Education Network 


390 


20 


Basic Research and 
Human Resources 3 


183 


10 


Total 


1.917 


100 



SOURCE: Congressional Budget Office using data from Office 
of Science and Technology Policy, "The Federal High 
Per/ormance Computing Program" (September 8, 
1989), p. 46. 

NOTES: HPCC = High Performance Computing and Commu- 
nications. 

Incremental funding is the additional money appro- 
priated to the HPCC agencies above the level the 
agencies were receiving at the start of the HPCC pro- 
gram for their activities in this area. Numbers may 
not add to totals because of rounding. 

a. In addition, 1 5 percent of each of the other three program 
components are to be devoted to this area. 

linearly until it is the right size for the task at 
hand. Scaling refers to the addition of proces- 
sors to the system so that the system's perfor- 
mance increases in proportion to the number 
of processors added. 

Computer design visionaries believe that 
the proliferation of computer designs using 
the same microprocessors is part of the new 
wave in computer architecture. 1 In the fu- 
ture, they argue, computers will not be cate- 
gorized as a microcomputer, minicomputer, 
mainframe, supercomputer, and so on, each 
with a different architecture. Rather, comput- 
ers will be characterized by the number of 
standard microprocessors in the machine: one, 



1. David Patterson. "Expert Opinion: Traditional Main* 
frames and Supercomputers Are Losing the Battle," 
IEEE Spectrum (January 1992), p. 34. 



a few, many, and very many. Most important 
software applications will be perfectly trans- 
portable between them, merely running faster 
as more processing nodes are added to the 
computers. 

Most modern U.S. top-of-the-line supercom- 
puters, including conventional supercomput- 
ers, are parallel in the sense of having more 
than one processor, and the trend is clearly to 
increase the number. Where the technology 
strategies differ between conventional and 
massively parallel machines is in how fast to 
increase the number of processors. To achieve 
the highest peak speeds, HPCC has opted to 
increase it rapidly. 

The type of hardware-scaling that HPCC is 
exploring can, to some extent, be replicated in 
software today. Although many high-perfor- 
mance computer systems are not scalable, 
they have software that is compatible with 
that of more powerful computers. For exam- 
ple, the entry-level Cray Y-MP EL-a conven- 
tional supercomputer-has roughly 1 percent 
to 3 percent of the processor performance of 
the top-of-the-line Cray Y-MP CCO at between 
1 percent and 3 percent of the cost. They both 
can run the same software, but at different 
speeds. Conventional supercomputers, how- 
ever, cannot be upgraded easily. Buying a 
new machine is easier and less costly than 
making an existing machine work more rap- 
idly. Computers with scalable architecture, 
therefore, allow users flexibility in tailoring 
the hardware, and consequently the speed, to 
the task at hand. 



Components 

The development of supercomputer hardware 
focuses on four areas: 

o Research for future generations of comput- 
ing systems addresses the concepts under- 
lying advanced scalable architecture, com- 
ponents, packaging, and systems software. 
The goal of this research is to ensure that 
the requisite technology is available for 
new systems and to provide a solid techno- 



:RLC 



27 



12 PROMOTING HIGH-PERFORMANCE COMPUTING AND COMMUNICATIONS 



June 1993 



logical base for the next generation of 
high-performance computers. 

o System design tools focuses on the develop- 
ment of computer-aided design tools and 
frameworks for integrating multiple tools. 
The tools include computer-aided design, 
analysis, simulation, and testing. The 
frameworks are to allow computer design- 
ers to take data or output from one com- 
puter design tool and integrate it as seam- 
lessly as possible into other design tools. 
The intent of this effort is to speed up con- 
struction of prototypes. 

o Advanced prototype systems encompasses 
the development of experimental systems. 
The dual goals of these activities include 
both increasing the speed and reducing the 
size and cost of the scalable supercomputer 
hardware, thus making it accessible to a 
broader class of users. The federal govern- 
ment and the supercomputer vendors will 
share development costs. 

o Evaluation of early systems places experi- 
mental machines with experts who use 
and evaluate them. Such evaluations in- 
clude establishing universally agreed- 
upon performance criteria and widespread 
publication of results. Some of the early 
experimental systems may begin work on 
the grand challenges discussed in Chapter 
1, such as some experiments in alleviating 
pollution or in high-energy physics. 

Budget 

The importance of the hardware component of 
the HPCC program is reflected in its share of 
overall funding. In the original budget plan, 
hardware accounted for roughly 36 percent of 
all additional funds, or $680 million over five 
years. It was scheduled to increase steadily in 
annual increments of between $30 million and 
$50 million through 1996. More than two- 
thirds of the hardware funding, roughly $460 
million, was for the manufacture and testing 
of prototypes of advanced-design supercom- 
puters. 



Advanced Software 
Technology and 
Algorithms 

Because these massively parallel supercom- 
puters operate under a fundamentally differ- 
ent architecture than other computers, they do 
not have the software library, developed over 
40 years, that other computers inherit. This 
element of the HPCC program will produce ge- 
neric software and algorithms for research ap- 
plications. It also contains funding to create 
complete supercomputer applications that can 
work on supercomputers attached to net- 
works. The goals are to help solve the applica- 
tion problems posed by the grand challenges, 
make the software easier to use and more reli- 
able, and apply the knowledge so gained to 
other computational problems. 

Components 

Development of the software for high-perfor- 
mance computers covers four areas: 

o Software support for grand challenges 
aims to develop high-performance soft- 
ware to address issues related to the grand 
challenges, including global climate 
change, advanced materials research, and 
biotechnology. The problems are being se- 
lected on the basis of their national impor- 
tance, their potential to advance computa- 
tional technology, their potential to yield 
spill-over benefits, and the exten* to which 
other parties-particularly private firms- 
might share the development costs. 

o Software components and tools seeks to de- 
velop applications for high-speed computer 
networks and generic software for high- 
performance computers. Such software in- 
cludes that which currently is available for 
conventional computers-for example, soft- 
ware that enables programmers to design 
fast software or helps them find errors in 
the software they have written. Because 
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HPCC involves many agencies and private 
vendors, this software is intended to oper- 
ate on different brands of supercomputers. 

o Computational techniques funds research 
on algorithms, parallel languages, and nu- 
merical analyses. The advent of massively 
parallel supercomputers requires the de- 
velopment of techniques optimized in ways 
different from those of single -processor 
machines. 

o High-performance computing research cen- 
ters supports the deployment of new HPCC 
computer hardware to research centers 
and provides fresh opportunities for re- 
search as well as transfer of technology to 
large numbers of researchers. The intent 
is to provide these centers with the new 
hardware and connect them through the 
National Research and Education Net- 
work. Doing so will permit a wide range of 
software experiments. 



Budget 

The software element accounted for about 35 
percent of the incremental HPCC funding, or 
roughly $660 million. About half of that will 
be spent for R&D on tools and techniques, and 
about 30 percent will fund the research cen- 
ters. The grand challenges themselves ac- 
count for less than a quarter of incremental 
spending for software. 



National Research and 
Education Network 

The National Research and Education Net- 
work (NREN) is intended to make data com- 
munications services available to more re- 
searchers and to government and educational 
institutions. It would also increase the speed 
and quality of such services. A by-product of 
this effort would be the further development of 
the commercial high-speed data communica- 



tions industry by using the research and edu- 
cation communities as the first customers-the 
communities in which the applications and 
other ancillary technologies are most likely to 
be developed. 



Components 

This portion of the HPCC program has two 
components: 

o The Interagency Interim National Re- 
search and Education Network is based on 
the National Science Foundation Network 
(NSFNET), the Department of Energy 
(DOE) Energy Sciences Network, the Na- 
tional Aeronautics and Space Administra- 
tion's Science Internet, and other networks 
supporting research and development. 
This component includes a phased process 
of upgrading and expanding the U.S. por- 
tion of the research-oriented Internet so 
that it can serve more of its intended com- 
munity with, insofar as feasible, data 
transmission rates of 1 billion bits (one 
gigabit) per second.2 The interagency net- 
work has been upgraded from transmis- 
sion speeds of 1.5 million bits per second, 
commonly called T-l, to 45 million bits per 
second, commonly called T-3. The DOE is 
also upgrading its research network. 

o Gigabit research and development funds 
R&D on network switches, protocols, and 
other hardware and software needed to de- 
ploy the initial gigabit network. Much of 
this R&D is to be accomplished through six 
joint private/public research test beds. A 
key feature of this program is its close col- 
laboration with industry to encourage the 
transfer of the resulting technology to the 
U.S. telecommunications industry. 



2. Internet is an international network of computer net- 
works all using a common communications protocol and 
roughly centered in and around research and educa- 
tional institutions. For a more substantial discussion of 
Internet, see Chapter 4. 

2.9 
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Budget 

In the plan, the network portion of the HPCC 
program would receive only 20 percent-or 
$390 million-of the incremental funding. 
This funding would be equally divided be- 
tween setting up the interim NREN and doing 
R&D on the next generation of networks. 



Budget 

In the original plan, only 10 percent of all new 
funds for HPCC were directly assigned to ba- 
sic research and human resources. However, 
HPCC planning documents stipulated that 15 
percent of HPCS, ASTA, and NREN funding 
would be devoted to this general area. 



Basic Research and 
Human Resources 

The central goal of this portion of the HPCC 
program is to encourage the long-term growth 
of high-performance computing by ensuring 
that the infrastructure for basic research is de- 
veloped and that students now being trained 
as the next generation of programmers have 
the opportunity to pursue such research. 

Components 

This element of the HPCC program has four 
components: 

o Basic research aims to increase awards for 
R&D on high-performance computing ini- 
tiated by individual investigators. Such 
basic research may relate to one or more of 
the three main HPCC areas-massively 
parallel supercomputer hardware, soft- 
ware, and networking. 

o Research participation and training pro- 
vides more advanced training through 
workshops, fellowships, and other activi- 
ties at the postsecondary level. 

o Infrastructure provides upgrades of both 
equipment and software for computer sci- 
ence research facilities at universities. 

o Education, training, and curriculum in- 
volves the preparation of materials and 
courses for improving computer education, 
including more teacher training. 



Agency Responsibilities 

The HPCC program divides its tasks not only 
into the four elements, but also along agency 
lines. The program includes eight agencies 
with some level of responsibility for rortions of 
HPCC R&D (see Table 3). Althougn the agen- 
cy count has been rising, there is no single 
lead agency. The Office of Science and Tech- 
nology Policy is responsible for coordinating 
the individual agency efforts. 

The Advanced Research Projects Agency 
has major responsibility for R&D on hardware 
and generic software tools for both scalable 
supercomputers and networks. ARPA is fund- 
ing the development of scalable massively par- 
allel supercomputers and much of the basic 
software needed to operate these new systems 
successfully, such as tools for debugging and 
compiling software. ARPA is also paying half 
the federal portion of the gigabit test beds, 
where much of the network hardware R&D 
will occur. 

The Department of Energy's mission and 
history has endowed it with much of the fed- 
eral government's expertise with supercom- 
puters. DOE therefore has the task of evaluat- 
ing the scalable supercomputer systems devel- 
oped under the HPCC program. The depart- 
ment is also the potential user of these super- 
computer systems for research into nuclear 
weapons, global warming, and other energy 
matters and is responsible for developing soft- 
ware applications in these areas. As a poten- 
tial user of high-speed computer networks, 
DOE will begin a major upgrade of its Energy 
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Sciences Network to link its facilities as part 
of the HPCC program and will probably be the 
first federal agency to provide near-gigabit 
speeds over a network. 



The other agency with responsibility for 
overall hardware is the National Science 
Foundation (NSF). Its principal responsibility 
is to coordinate deployment of the National 



Table 3, 

Agency Responsibilities Under the HPCC Program 







Advanced 










jU 1 IWi l C 








High-Performance 


Technology 


Research and 


Basic Research 


Agency 


Computing Systems 


and Algorithms 


Education Network 


and Human Resources 


Advanced Research 


Technology development 


Technology development 


Technology development 


University programs 


Projects Agency 


and coordination for 


for parallel algorithms 


and coordination for 






supercomputer systems 


and systems software 


gigabits networks 




Department 


Technology development 


Energy applications 


Access to energy 


Basic research and 


of Energy 


Systems evaluation 


research centers 


research facilities 


education programs 






Energy grand challenge 


and data bases 








and computation 


Gigabits applications 








research 


research 








Software tools 






National 


Aeronautics and space 


Software coordination 


Access to aeronautic and 


Research institutes 


Aeronautics 


application test beds 


Computation 


spaceflight research 


and university 


and Space 




Research in: 


centers 


block grants 


Administration 




Aerosciences 










Earth and space 










sciences 






National Science 


Basic architecture 


Research in: 


Facilities coordination 


Programs in: 


Foundation 


research 


Software tools. 


and deployment 


Basic research 




Prototyping 


data bases 


Gigabits research 


Education 




experimental 


Grand challenges 




Training/curricula 




systems 


Computer access 






National Institute 


Research in systems 


Research in: 


Coordinate performance 




of Standards 


instrumentation and 


Software indexing and 


assessment and standards 




and Technology 


performance measurement exchange 


Programs in protocols 






Research in interfaces 


Scalable parallel 


and security 






and standards 


algorithms 






National Oceanic 




Ocean and atmospheric 


Oceanographicand 




and Atmospheric 




computation research 


atmospheric mission 




Administration 




Software tools 


facilities 








Techniques 


Data-base access 




Environmental 




Research in environ- 


State environmental 


Technology transfer 


Protection Agency 




mental computations, 


mission assimilation 


to states 






data bases, and appli- 




University programs 






cation test beds 






National Institutes 


Systems evaluation 


Medical application 


Development of 


Basic Research 


of Health 


and performance 


test beds for 


intelligent gateways 


Internships for parallel 




analysis 


medical computation 


Access for academic 


algorithm development 






research 


medical centers 


Training and career 










development 



SOURCE: Congressional Budget Office based on data from the Federal Coordinating Council for Science, Engineering, and 
Technology. 
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Research and Education Network in several 
stages, depending on the pace of the R&D ac- 
complishments. NSF also houses the basic re- 
search efforts in both hardware and software. 

The remaining agencies' responsibilities for 
developing hardware and related software ap- 
plications are largely associated with their in- 
dividual missions: NASA, space; NOAA, 
oceanographic and atmospheric research; the 
Environmental Protection Agency, the envi- 
ronment. Only the National Institute of Stan- 
dards and Technology, which sets some net- 
work standards, has crosscutting responsibil- 
ity. 

Role of the Federal Coordinating 
Council on Science, Engineering, 
and Technology 

The federal entity responsible for coordinating 
HPCC research and development is the Fed- 
eral Coordinating Council for Science, Engi- 
neering, and Technology (FCCSET) within the 
Office of Science and Technology Policy. 
Agencies participating in HPCC meet regu- 
larly under the auspices of FCCSET. How- 
ever, FCCSET has no budgetary power or oth- 
er authority to realign priorities or make bind- 
ing decisions. Agencies attend meetings and 
present proposals for new R&D on data com- 
munications or scalable supercomputers, but 
FCCSET neither sets priorities nor decides 
which programs should go forward. Thus the 
National Aeronautics and Space Administra- 
tion can decide whether to reduce HPCC fund- 
ing to accommodate the space station or other 



high-priority programs, but no one has the au- 
thority to decide HPCC funding trade-offs 
among agencies. 

Much of the high-speed data communica- 
tions work being done within each agency is 
also not necessarily represented at FCCSET. 
For example, the National Library of Medi- 
cine represents the National Institutes of 
Health, even though much of the work regard- 
ing medical imaging technology at NIH is 
done elsewhere and, in the past, had been 
done independent of the HPCC program. 
Similarly, efforts by the armed services to 
transmit medical images at relatively high 
speeds have been undertaken outside HPCC. 
(Part of the problem in describing the HPCC 
budget comes fro*.i the fact that member agen- 
cies continue to increase the portion of their 
activities described as belonging in the HPCC 
program.) 

The HPCC program has addressed this 
problem by creating a National Coordination 
Office for High-Performance Computing and 
Communications, which provides the Con- 
gress and the public with a point of entry into 
the initiative. The National Coordinating Of- 
fice is responsible to a FCCSET committee and 
its director is a special assistant to the Direc- 
tor of the Office of Science and Technology 
Policy. This new office is intended to coordi- 
nate interagency budget and reporting re- 
quirements, but it has neither a budget nor a 
full-time staff. Furthermore, the director is 
also the director of the National Library of 
Medicine, which presumably will continue to 
occupy a substantial portion of his time. 
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Chapter Three 

HPCC and the Development 
of Supercomputer Markets 



One intent of the High Performance 
Computing and Communications pro- 
gram is to ensure continued leadership 
of U.S. firms in the high-performance comput- 
ing arena , including supercomputers and eth- 
er fast computers, in the belief that such lead- 
ership would enable these firms to increase 
their performance in the other segments of 
the computer market. Policymakers also ex- 
pect to make the benefits of additional corn- 
put 3r technology more widely available by 
stimulating development of more applications 
for supercomputers. They hope that increas- 
ing access to high-performance computers and 
increasing the quality of the software for 
those computers will accelerate the wide- 
spread diffusion of this technology throughout 
the economy. 



HPCC and 
Supercomputers 

The stated goal of HPCC program officers is to 
apply leverage to federal monies by funding 
only those areas where they feel private dol- 
lars are not likely to go and that appear to be 
on a path of rapid technological advance. Con- 
sequently, they are more likely to fund revolu- 
tionary than evolutionary advances. 

To date, the HPCC supercomputer program 
has developed some early prototype systems 
that operate at 100 billion operations per sec- 
ond. Given the rapid rate at which semicon- 
ductor technology advances and the intense 
competition among producers of supercom- 



puter hardware, HPCC will most likely de- 
liver a prototype of a supercomputer with a 
peak performance of 1 trillion operations per 
second. Whether this machine will be able to 
perform useful work for a wide variety of users 
is more open to question. 

The Promises of New 
Supercomputer Technology 

HPCC planners expect to produce supercom- 
puters that cost the same as today's supercom- 
puters but deliver between a hundred and a 
thousand times the power. This added power 
would permit supercomputers to solve prob- 
lems that are beyond the capabilities of cur- 
rent supercomputers. Such solutions might 
give U.S. industry a competitive edge by en- 
hancing the design and analytic capabilities of 
U.S. firms. From a policy perspective, then, 
HPCC will yield substantial benefits if the 
power of the scalable massively parallel super- 
computer expands the uses and, hence, the 
market for high-performance computers. In 
this sense, HPCC is trying to shift both the 
supply curve for supercomputers (that is, ex- 
pand the supply at a given price) and the de- 
mand curve by creating new uses for the im- 
proved supercomputers. 

The new supercomputer technology could 
also directly strengthen the competitiveness of 
the U.S. computer industry. Planners believe 
that supercomputer technology leads all com- 
puter technology- that is, improvements ap- 
pear on these machines first, are tested and 
improved, and then move onto other comput- 
ers. In this way, the program would further 
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enhance the lead of U.S. technology in com- 
puters overall. 

Unsettling Questions 

This vision of success is not in complete corre- 
spondence with the market for high-perfor- 
mance computers. Far from driving computer 
technology, supercomputers have largely been 
involved in areas of technology that are not 
growing rapidly. Even now, massively par- 
allel supercomputer technology draws largely 
on mainstream computer component technol- 
ogy rather than leading it. But it would ap- 
pear that HPCC has the potential to improve 
software and processor communications tech- 
nology in ways that might have wider applica- 
tion. 

HPCC's vision of the development of com- 
puter technology also ignores the most impor- 
tant development in high-performance com- 
puting of the 1980s: the engineering worksta- 
tion. Sales of these technical computers-high- 
performance versions of the personal com- 
puter-have grown substantially, just as su- 
percomputer sales have slowed, suggesting 
that workstations are competing with super- 
computers for many uses. If this analysis is 
correct, HPCC is attempting to increase com- 
puter speed at a time when the market, in- 
cluding the scientific market, may be valuing 
other factors such as cost and convenience 
more highly than raw speed. 

Finally, the massively parallel supercom- 
puters, after a decade of federal R&D support, 
have yet to demonstrate their utility as 
general-purpose computers. Translating ex- 
isting software for them has proved difficult. 
For a variety of reasons that will be explored 
below, they match the performance of conven- 
tional supercomputers only in the most spe- 
cialized problems. They are generally cheap- 
er, however, than the high-end conventional 
supercomputers and may gain a following on 
that basis. 

Massively parallel computer systems al- 
ready have a substantial market in commer- 



cial data-base management as specialized 
(single-purpose) machines. Half of all main- 
frame computer use involves data-base ma- 
nipulation; even if their only sales were to cus- 
tomers with such uses, parallel architecture 
computers would have a substantial market. 
Whether they can move into general-purpose 
use is at present unclear. 



Analysis of the 
Supercomputer Market 

The supercomputer market represents only a 
minute fraction of annual computer sales and 
an even smaller fraction of installed comput- 
ers. Roughly 10 million to 15 million personal 
computers are sold each year. Engineering 
workstations account for 300,000 to 400,000 
units. Computer producers also sell 10,000 to 
20,000 mainframe computers each year.l 

By contrast, only a few hundred supercom- 
puters are sold each year. 2 These machines 
have a high value, however, totaling about 
$1.8 billion in worldwide sales in 1992.3 As of 
1990, slightly more than 600 supercomputers 
were operational worldwide.4 

Growth in the demand for supercomputers 
has slowed substantially in recent years. Ac- 
cording to one recent industry estimate, the 
world market for supercomputers grew from 
sales of less than $90 million to more than $1 
billion between 1980 and 1988. Since then, 



1. Egil Juliuasen and Karen Juliussen, The Computer In- 
dustry Almanac, 1989 (New York: Simon & Schuster, 
1988), pp. 3.4-3.5. 

2. John B. Jones and Theresa Liu, "Cray Computer Corpo- 
ration** (Montgomery Securities, San Francisco, Calif.. 
July 23, 1991), p. 4. 

3. Department of Commerce, 1991 U.S. Industrial Outlook 
(1991), p. 26-6. 

4. Los Alamos National Laboratory, Department of En- 
ergy, "High Performance Computing and Communica- 
tions: Investment in American Competitiveness" (pre- 
pared under contract by Gartner Group, Stamford, 
Conn., March 15, 1991), p. 75. 
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however, demand for supercomputers has 
grown only 6 percent annually.5 Demand for 
entry-level supercomputers, which are typi- 
cally much less expensive and almost as pow- 
erful, has remained high. 



Figure 1. 
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The recent slowdown is attributable in part 
to the decline in federal demand brought 
about by the end of the Cold War and the re- 
cession, but also to the increased power of en- 
gineering workstations, which will be dis- 
cussed below. 6 Assuming that defense spend- 
ing continues to decrease throughout the 
1990s, demand for supercomputers may not 
resume its upward climb for 5 to 10 years un- 
less emerging environmental or other applica- 
tions grow sufficiently to replace military de- 
mand. 



Supercomputer Market 
Segments 

The supercomputer market has four general 
submarkets: vector supercomputers, mini- 
supercomputers, massively parallel super- 
computers, and vector facilities (see Figure 1). 
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Japanese and, until recently, U.S. firms. 7 In 
1991, roughly 60 of these vector supercomput- 
ers were shipped worldwide. 8 

The minisupercomputer (or departmental 
supercomputer) is sold to cost-sensitive users 
or those with limited needs. 



Vector supercomputers usually consist of 
between 1 and 16 very fast processors with 
special features that allow them to work on 
strings of numbers (vectors) quite rapidly. 
The market for large vector supercomputers is 
traditionally associated with the name Cray 
Research, but is also occupied by a handful of 



5. Los Alamos National Laboratory, "High Performance 
Computing and Communications" p. 73. Other analyses 
differ in both absolute size and rate of growth. However, 
there seems to be more general agreement that growth 
in the demand for the largest supercomputers haa 
slowed. See Department of Commerce, U.S. Industrial 
Outlook 1991, p. 28-5. At least part of the difference in 
size of total market comes from the imprecise nature of 
the definition of the term supercomputer. 

6. Between 1984 and 1989, public agencies bought an aver- 
age of 17 of the top-of* the* line supercomputers per year, 
compared with only 11 in 1990. Private purchases fell 
from an average of 13 to 10. See Department of Com- 
merce, Technology Administration, "Global Markets for 
Supercomputers: The Impact of the U.S .-Japan Su- 
percomputer Procurement Agreement" (October 1992), 
p. 14. 



The largely experimental massively par- 
allel machines using arrays of inexpensive 
microprocessors have started to sell more 
widely. Currently, most such sales are for 
smaller versions of the massively parallel ma- 
chines with fewer than 50 or 100 microproces- 
sors. Such configurations allow purchasers to 
experiment with the technology at relatively 
low cost. 

At the rapidly growing end of the market is 
the vector facility, which takes a mainframe 
computer and supercharges it with special ca- 
pabilities. Vector facilities can rapidly do 



7. Sometimes vector supercomputers are also called vector 
parallel supercomputers because many of them have be- 
tween 4 and 16 processors. Most of the time each proces- 
sor is assigned to a different user -that is, they are not 
used in parallel. 

8. Department of Commerce, 1992 C/.S. Industrial Outlook 
(1992), p. 27-6. 
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computations on strings (vectors) of numbers. 
The rest of the computer program remains un- 
affected. Since programs that need supercom- 
puters typically have large strings of computa- 
tions, vector facilities can give a mainframe 
some supercomputer capabilities. The Depart- 
ment of Commerce data do not break out the 
cost of the vector facility from that of the 
mainframe computer. 

Sources of Supercomputer 
Demand 

The government is the largest buyer of the 
large vector supercomputers and the mas- 
sively parallel processor-based supercomput- 
ers. This demand has been driven largely by 
the need to design nuclear weapons at the De- 
partment of Energy's national laboratories. 
Since the national laboratories were the first 
to adopt many of the new computing technol- 
ogies, their use carried with it a stamp of ap- 
proval. In addition, the national laboratories 
served the socially useful function of being on 
the so-called '"bleeding edge" of technology: 
they made the mistakes and absorbed the 
costs of making the new models of supercom- 
puters usable. 

At the opposite end of the spectrum are very 
price-sensitive users of supercomputers. 
These users, typically private firms, have a 
more mundane use for the supercomputer: de- 
signing better products. The cost-sensitive us- 
er currently has three options: the minisuper- 
ccmputer, a vector facility attached to a main- 
frame computer, or a high-end workstation. 
Despite the presence of high-end worksta- 
tions, the low end of the supercomputer mar- 
ket is growing more rapidly than the high end. 

The market for massively parallel super- 
computers has been growing rapidly, up 
roughly a third in 1992 to almost $300 mil- 
lion, according to Department of Commerce 
estimates.^ Most of this growth, however, re- 



9. Department of Commerce, 1993 U.S. Industrial Outlook 
(1993), p. 26-7. 



fleeted price increases or increases in average 
computer size; unit sales rose only 8 percent. 
Most demand is still in federal laboratories or 
supercomputer centers, where the machines 
are available as part of the general computa- 
tional services the centers provide. Commer- 
cial users are still relatively rare. Although 
there has been a great deal of discussion about 
"massively" parallel machines, most units 
currently sold can best be described as "mod- 
erately" parallel-that is, they have fewer 
than 64 processing nodes. Their moderate 
parallelism reduces the size of the initial in- 
vestment and the complexity in testing this 
new technology. 



The Supercomputer 
Market and Technology 
Spinoffs 

Supercomputers are widely perceived to be the 
motivating force behind advances in computer 
technology. 10 According to this view, new 
computer technologies are introduced through 
this small but crucial market at the apex of 
the technology pyramid; successful technol- 
ogies then trickle down to the broader market 
at the base. Although the market for super- 
computers is small, it is so performance-driven 
that it allows computer companies to test new 
ideas, thus providing a platform for new tech- 
nologies that mainstream computer users will 
see only later. 

A practical corollary of this view is that in- 
vestments in supercomputer technology may 
provide society with a higher return than 
similar investments in other parts of computer 
technology because these investments will 
trickle down to other users. In this way, ad- 
herents believe, federal investments in super- 
computer technology may benefit U.S. com- 
puter manufacturing firms by providing them 



10. For example, see Office of Technology Assessment, Com- 
peting Economies: America, Europe and the Pacific Rim 
(October 1991), p. 253. 
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with access to technology before their foreign 
competitors. 

Contradicting this view, however, is the 
secondary role supercomputer technology has 
played in two major advances of the 1980s: im- 
proved integrated circuits, and reduced-in- 
struction-set computer (RISC) architecture. 11 
These advances have been driven instead by 
the other end of the spectrum of computer 
technology-personal computers and engineer- 
ing workstations. Of course, some new tech- 
nology has come from supercomputers, but the 
major thrusts of computer technology develop- 
ment lie elsewhere. 

The workstation and personal computer 
markets have been at the heart of technology 
advances because the demand for such com- 
puters has grown rapidly enough to justify de- 
voting resources to solving the problems these 
markets confront (see Figure 2). Around 1980, 
all three market segments-personal comput- 
ers, workstations, and supercomputers-were 
small. Although the supercomputer market 
has grown to $1.8 billion, it has been dramati- 
cally outpaced by growth in both the personal 
computer and workstation markets, which in 
1991 exceeded $30 billion and $8.8 billion, re- 
spectively.^ Given the levels and growth in 
sales, companies anxious to become market 
leaders have pushed every aspect of the tech- 
nology, with the result that these markets see 
whole turnovers in their technology every few 
years. 



11. In RISC architecture, the computer can perforin fewer 
instructions, but it performs them rapidly. Complex 
instructions are then put together from simple individ- 
ual instructions. Conventional computer architecture, 
by contrast, includes many more and complex instruc- 
tions, which are performed more slowly. 

12. Supercomputer sales are based on Department of Com- 
merce, U.S. Industrial Outlook 1992, p. 27-6. Personal 
computer sales are from International Data Corp, a mar- 
ket research firm, and appeared in Jim Seymour, "Plat- 
forms: How the PC Stacks Up," PC Magazine (May 12, 
1992), p. 115. Engineering workstation ae.lea are based 
on Dataquest estimates in Rick Whiting, **A Clash of the 
Giants Shakes the Low-End Workstation Market," Elec- 
tronic Business (April 27, 1992), p. 87. Because the 
workstation and personal computer markets overlap, the 
two numbers should probably not be added together. 
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a. The Department of Commerce provided no estimate for 
1989 supercomputer shipments consistent with those of 
other years. 



The manufacture of supercomputers, on the 
other hand, has not led to significant advances 
in general computer technology. The trade- 
offs in cost and performance that supercom- 
puter producers face are different from those 
of most other computer producers. For exam- 
ple, vector supercomputers must often be 
equipped with specialized liquid cooling facili- 
ties. Even when the manufacturers use more 
conventional technology, its application is 
likely to differ substantially from the practices 
of most electronics equipment producers. In 
limited areas, however, supercomputers have 
made a contribution to technology, most nota- 
bly in software. As engineering workstations 
have become rapid enough to provide timely 
mathematical solutions to engineering and 
scientific problems, software originally writ- 
ten for supercomputers has been translated for 
workstations. 

The trickle-down theory of technology may 
have corresponded to reality in the past. In 
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the 1950s and 1960s, high-performance com- 
puters led the general advance in computer 
technology. For example, the IBM Stretch 
computer, a high-performance predecessor to 
the famous IBM 360, pioneered a technique 
called pipelining to speed up computers. 13 
Now all modern computers have elements of 
pipelining. But more recent years may pro- 
vide a better indication of conditions in the 
near future. Recent spinoffs from supercom- 
puter technology have been concentrated in 
the mainframe computer market, where sales 
have leveled off and their relative market val- 
ue has declined to roughly one-quarter of com- 
puter sales. 

Recent Trends in Computer 
Technology Development 

The more significant advances in technology 
have occurred in integrated circuits, computer 
architecture, printed circuit boards, and com- 
puter disks. Appendix A describes major 
areas of computer technology in greater detail. 

Integrated Circuits. The most notable semi- 
conductor advances of the 1980s~such as those 
in computer memories and microprocessors- 
were made with the complex but relatively 
slow integrated circuits used in personal com- 
puters and workstations. By contrast, most 
vector supercomputers have used simple, fast 
integrated circuits. Semiconductor manufac- 
turing technology has also been driven by the 
needs of the complex, slow integrated circuits. 
The economies of scale of these large markets, 
combined with improved manufacturing tech- 
nology, allowed these integrated circuits to in- 
corporate more functions while becoming fast- 
er, making up most of the original difference 



13. Pipelining can best be thought of as an assembly line in 
which many different instructions are in various stages 
of completion at all times. See David Patterson and John 
Hennessy, Computer Architecture: A Quantitative Ap- 
proach (San Mateo, Calif.: Morgan Ksufmann Publish- 
ers, 1990), p. 338. For a more complete history of the 
Stretch computer and its contributions to computer tech* 
nology, see Kenneth Flamm, Creating the Computer. 
Government Industry and High Technology (Washing* 
ton, D.C.: Brookings Institution, 1988), pp. 90-95. 
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in speed between the integrated circuits used 
for small computers and those used for super- 
computers. 

Computer Architecture. The most impor- 
tant advance in computer architecture has 
been the f roliferation of reduced-instruction- 
set computing designs; conventional super- 
computer design, on the other hand, has con- 
centrated on vector arrays. Although the Ad- 
vance Research Projects Agency funded much 
of the early research on RISC as part of its ef- 
forts in high-performance computing, includ- 
ing massively parallel processors, the rapid 
development of this technology during the last 
decade is largely the result of private initia- 
tive in the workstation market. The most 
commercially successful massively parallel 
supercomputers now incorporate the RISC 
microprocessors developed for commercial 
workstations. 

When RISC designs first emerged, design- 
ers copied many of the features of existing 
mainframe and supercomputer architectures. 
However, RISC design moved aggressively, 
surpassing existing computer designs in many 
areas. 

Printed Circuit Boards and Other Pack- 
aging. Producers of conventional electronics 
equipment have had to accommodate fewer 
numbers of relatively more complex inte- 
grated circuits on their printed circuit boards. 
Conversely, supercomputer designers accom- 
modate many relatively simple integrated cir- 
cuits on their printed circuit boards. Because 
of the heat generated by many small but fast 
integrated circuits, supercomputer designers 
have had to turn to water and even freon cool- 
ing, while most computers remain air-cooled. 

Computer Disks. Although supercomputer 
designers demanded speed from their disks, 
the bulk of demand for computer disks focused 
on capacity, size, and price. The result has 
been a computer disk industry largely geared 
to serving the growing market for small com- 
puters. Now the newest disk technology- 
known as redundant arrays of inexpensive 
disks (RAID)-is coming to supercomputers, 
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after first being used in other computer mar- 
kets. 



Future Directions of Technology 
Spinoffs 

No one can predict the origins of commercially 
successful ideas and technology. The history 
of technology development is replete with in- 
novative tools and ideas originating from un- 
likely circumstances. In most cases, however, 
technology stays where it was invented; spin- 
offs, though desirable, are the exception, not 
the rule. If supercomputer technology re- 
mains true both to its own history and to the 
history of technology development in general, 
it will probably not result in many component 
spinoffs into other parts of the computer in- 
dustry, especially the rapidly growing seg- 
ments of that industry. 

Component Technology. Unlike previous 
generations of supercomputer technology, the 
massively parallel supercomputers, such as 
those being developed by HPCC, use many of 
the same components as engineering work- 
stations. Indeed, the very existence of mas- 
sively parallel supercomputers is predicated 
on the availability of high-performance com- 
mercial semiconductor technology. Much of 
the improvement in the performance of mas- 
sively parallel supercomputers during the last 
decade can be attributed to the use of increas- 
ingly sophisticated workstation microproces- 
sors. 14 

In fact, within the market for massively 
parallel supercomputers, the use of micropro- 
cessor technology designed specifically for su- 
percomputers is often regarded as a weakness. 
Such technology, because it is not continually 
pushed by the brutally competitive forces of 
the workstation market, is felt to be in danger 
of falling behind its commercial counterparts. 
Technologists in the field therefore see compo- 



14. For this history of improvement, see John Van Zandt, 
Parallel Processing in Information Systems (New York: 
John Wiley and Sons, 1992). 



nent spinoffs flowing mainly from workstation 
technology to supercomputer technology. 

Some HPCC advocates argue that the price 
of computer hardware will decrease substan- 
tially below recent trends because of mas- 
sively parallel supercomputers. But mas- 
sively parallel supercomputers are likely to 
represent only a small fraction of the market 
for most computer components, and hence are 
not likely to be the source of economies of scale 
or of learning curves. Consequently, HPCC 
will probably not result in a drastic drop in the 
price of computer hardware, as the expansion 
of the personal computer and computer work- 
station markets did in the last decade. 

Areas of Likely Spinoff. Two of the likeliest 
areas of spinoff from the massively parallel 
supercomputer to other types of computers do 
not involve components but communication 
between processors and the creation of par- 
allel solution paths in software problems. 

Most massively parallel supercomputers 
are composed of many RISC microprocessors. 
In getting these individual microprocessors to 
communicate and coordinate rapidly, HPCC 
will have to confront the exigencies of proces- 
sor communication to a much greater extent 
than does the computer market as a whole. 
Both the speed and frequency of communica- 
tion between microprocessor nodes that de- 
signers of these systems must deal with 
present greater challenges than computer de- 
signers have had to face until now. As more 
computers are joined in computer networks, 
the problems of coordination will become more 
severe, and the experience gained in trying to 
tie microprocessors together within a mas- 
sively parallel supercomputer may become 
relevant. 

The transfer of technology may be limited, 
however. Communication and coordination 
among microprocessors in a massively parallel 
supercomputer must be u.pid and tight. By 
contrast, most computer network applications 
involve slower communication and looser co- 
ordination. Whether the principles needed to 
solve problems of tight coordination and rapid 
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communication can be economically applied to 
more general computer communications is not 
clear. As noted above, supercomputers push 
performance to such extremes that many of 
the solutions they devise are uneconomic or 
inappropriate for other types of computers. 

The other area of substantial innovation in 
massively parallel supercomputer technology 
involves making problems parallel. This pro- 
cess involves rethinking problems and re- 
arranging them so that their component ele- 
ments can be worked on simultaneously. The 
methods of finding parallels in problems may 
have wider applicability. For example, re- 
searchers who have rewritten software appli- 
cations to make them parallel for the mas- 
sively parallel supercomputer have discovered 
that these applications also run better on vec- 
tor supercomputers, sometimes faster than on 
the parallel system. 15 This effort to make in- 
ternal parallelisms more explicit may be one 
of the areas in which massively parallel 
supercomputer researchers advance general 
computer technology. 



Obstacles to Widespread 
Commercial Use of HPCC 
Technology 

The main obstacle to developing widespread 
commercial markets for HPCC -developed 
supercomputer technology is not that a com- 
peting supercomputer technology will emerge, 
but rather that cheaper workstation technol- 
ogy will preempt further substantial growth of 
the supercomputer market as a whole. At 
present, more commercial design problems are 
being solved on workstations than on super- 
computers. 



Another obstacle to the widespread use of 
HPCC-sponsored supercomputer technology 
in the near term can best be described as eco- 
nomic inertia: current supercomputer hard- 
ware and software are very good and continue 
to improve. Furthermore, close to 20 years 1 
worth of software has been written to run rap- 
idly on that hardware. Given the difficult 
problems of writing software for massively 
parallel supercomputers, one cannot expect 
the massively parallel supercomputers to sup- 
plant vector supercomputers soon; they do not 
yet seem able to run most software as rapidly 
as the vector supercomputers. Nevertheless, 
supercomputer centers are buying massively 
parallel supercomputers as supplements to 
their vector supercomputers so they can serve 
clients who need the additional power. This 
market is still developing. 

The most apparent area of near-term com- 
mercial demand for massively parallel com- 
puters is in data-base management. The mar- 
ket for parallel special-purpose computers for 
managing data bases is almost as large as the 
market for massively parallel supercomput- 
ers. It remains to be seen whether the produc- 
ers of massively parallel supercomputers can 
reposition their products to serve this market, 
or whether the firms that currently serve this 
market can break into the general-purpose 
computer market. 

Most analysts believe that parallel super- 
computers and, more generally, parallel com- 
puters, are indeed the wave of the future. Ex- 
perts disagree on how near and how parallel 
that future is and on whether the economy 
will get there through incremental steps or 
major leaps. 16 By trying to leapfrog the devel- 
opment of intermediate technology, producers 
of massively parallel supercomputer hardware 
risk leaving software producers and users 
with no simple path for the evolution of their 
products. 



15. George Cybenko and David Kuck, "Revolution or Evolu- 16. Cybenko and Kuck, "Revolution or Evolution?** pp. 39- 

tion?** IEEE Spectrum (September 1992), p. 41. 41. 
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Growth in the Engineering 
Workstation Market May Slow 
Further Substantial Growth in 
the Supercomputer Market 

As growth in the supercomputer market has 
slowed, the engineering workstation market 
has continued to grow at a very high rate, as 
shown in Figure 2. Since both types of com- 
puters are used for numerical analysis and 
are~to some extent-interchangeable, work- 
stations may be performing work that pre- 
viously would have been performed on a su- 
percomputer. Both markets were small in the 
early 1980s, but the workstation market has 
grown to several times the size of the super- 
computer market. 

The increasing power of engineering work- 
stations has spurred their growth relative to 
that of supercomputers. The speed and low 
cost of many high-end engineering worksta- 
tions make them a logical substitute for a su- 
percomputer. They are quite popular among 
engineers and designers; the workstation is al- 
ready nearby and, at the margin, it is virtu- 
ally free to use. Consequently, advances in 
workstation technology and speed may further 
limit the supercomputer market. 

Even the positive developments in software 
for supercomputers can become a liability for 
supercomputer hardware sales. As supercom- 
puter software becomes transferable to work- 
stations, ijb establishes a self- reinforcing trend. 
Software programs that previously could run 
only on supercomputers have already been 
transferred to workstations, including some 
programs that perform specialized numerical 
analysis, which had been the forte of the su- 
percomputer. 17 Of course, not all problems 
that could once be solved only on supercom- 
puters are going to workstations. Many prob- 
lems are simply beyond the power of a work- 
station to solve economically. But the work- 
station permits a much finer segmentation of 



17. Jeffrey Young, "Crashware," Forbes, April 13, 1992, pp. 

no-112. 



the market for numerical analysis: the little 
problems go to workstations, the big problems 
go to supercomputers, and some analyses can 
be performed on either. 

In fact, one might argue that, in the United 
States, computer tasks go to supercomputers 
only when the data needed for their solution 
exceed the ability of most workstations to re- 
trieve and use the data rapidly. 18 These very 
often are tasks such as designing nuclear 
weapons, sifting through electronic intelli- 
gence, or other traditional supercomputer 
problems where cost is not of paramount con- 
cern. The market is more likely to favor tasks 
that could have been solved on a supercomput- 
er had supercomputers been ubiquitous and 
cheap. Thus, in essence, the expanding need 
for numerical processing is more likely to be 
satisfied on a workstation than on a supercom- 
puter. To some extent, the workstation may 
do to the supercomputer what the personal 
computer did to the mainframe-limit its de- 
mand. 

Resolution of some of the software problems 
of the massively parallel supercomputers that 
HPCC is working on may inadvertently help 
workstations take over part of the supercom- 
puter market. As noted above, many of these 
massively parallel supercomputers are com- 
posed of the same microprocessors that power 
the workstations; each microprocessor may 
have its own memory and some peripheral 
chips, just like workstations. In short, these 
massively parallel supercomputers are really 
many "workstations" within one box. Soft- 
ware developments that permit many of these 
workstations to work together within one box 
may also permit many freestanding worksta- 
tions to do the same. Indeed, HPCC is funding 
research to speed such developments. 

Software already exists that allows clusters 
of freestanding workstations on a network to 
use each other's computational resources to 
produce a computing machine that mimics 



18. Mark Furtney and George Taylor, "Of Workstations and 
Supercomputers," IEEE Spectrum (May 1993). pp. 64-68. 
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much of the power of a supercomputer. 19 With 
this software, problems are divided among dif- 
ferent workstations, just as they are within a 
massively parallel supercomputer, while the 
different parts of the software communicate 
back and forth between different worksta- 
tions. This type of software is currently in a 
relatively primitive state and works best with 
problems having parts that are fairly indepen- 
dent. Clustered workstations are also multi- 
purpose: they can be used as stand-alone com- 
puters during the day and as parts of super- 
computers when not occupied. 

But using workstations in this manner has 
serious limitations. Communication between 
freestanding workstations is a couple of orders 
of magnitude slower than between the work- 
stations inside a massively parallel supercom- 
puter. Consequently, until network commu- 
nications technology becomes much faster, 
there will be whole classes of problems for 
which such clusters are inappropriate. 

Advances in network technology also pro- 
vide the most likely route through which com- 
puting resources will be "scaled." As was 
noted in Chapter 2, HPCC is developing high- 
performance computer hardware that can be 
scaled linearly by simply adding more comput- 
ing nodes. The basic architecture will not 
change-it will just grow faster. Advanced 
network technology, however, also allows us- 
ers to create "virtual" scaling by simply add- 
ing more computer resources as they are need- 
ed. 20 Although virtual scaling is not likely to 
allow as fine increments in capabilities as 
purely scalable hardware, it may be more eco- 
nomic-allowing more investigators to make 



19. Alexander Wolfe, "Parallel Too la Kick Applications into 
High Gear," Electronic Engineering Times (March 30, 
1992), pp. 30,60, and 82. 

20. For examples of adding computer resources to create a 
larger computing resource through networks, see the 
presentations of Larry Smart of the National Center for 
Supercompu ting Applications, University of Illinois, and 
Gene Feldman of the NASA/Goddard Space Flight Cen- 
ter at the Revolution in Supercomputing Symposium, 
January 27, 1993, Washington, D.C., sponsored by Sili- 
con Graphics. Inc. 



part-time use of a single resource-than are 
simple additions to hardware. 

HPCC is devoting substantial resources to 
resolving the software problems involved in 
assigning tasks to groups of processors. It has 
joined workstation producers in funding much 
of the research on workstation clusters. 
Should generic solutions be found, the work- 
station market may benefit substantially. 
Thus, efforts by HPCC to develop network 
software and some classes of hardware may af- 
fect the commercialization of HPCC-supported 
hardware in other markets. 

Vector Supercomputing 
Technology May Limit the Near- 
Term Growth of the Massively 
Parallel Supercomputer Market 

The quest to make massively parallel super- 
computers the dominant supercomputer ar- 
chitecture faces a well-entrenched incumbent: 
the vector supercomputer. Displacing vector 
supercomputers from their current position is 
not likely to be easily or quickly accomplished. 
It is not yet certain that the higher theoretical 
peak speeds of the massively parallel super- 
computers will translate into features that the 
marketplace will value. The difficulty in pro- 
gramming the massively parallel supercom- 
puters as well as their lower performance on 
many kinds of problems may limit their share 
of the supercomputer market. Finally, many 
massively parallel supercomputers are in- 
compatible not only among manufacturers, 
but in some cases also between generations. 

Hardware for Vector Supercomputers. 
Because of differences in design, massively 
parallel supercomputers can provide very high 
speeds for certain types of problems, and vec- 
tor supercomputers can provide higher speeds 
for most problems. The central point to re- 
member is that a vector supercomputer is com- 
posed of a few- 16 at most-extremely fast cen- 
tral processing units, while a massively par- 
allel supercomputer is composed of hundreds 
or thousands of slower central processing 
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Figure 3. 

Simulated Performance of Three Supercomputers 
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NOTE: The vector supercomputer simulation is based on Cray Research's C-90. The massively parallel supercomputer simulations are 
based on Thinking Machines Corporation's CM~5and Intel's Paragon. 



units. The high theoretical speed occurs only 
when a problem can be divided into very many 
components.2l Then the massively parallel 
supercomputer can take advantage of its 
many processing units. But when a problem 
cannot be divided into many parallel compo- 
nents, the speed of the vector supercomputer's 
central processing unit becomes a winning ad- 
vantage. 

Most actual problems are not entirely mas- 
sively parallel or entirely composed of a few 
components, however. Typically, some aspects 



21. For a discussion of the limits to parallelism, see Jack 
Worlton, "Existing Conditions " in Supercomputers: Di- 
rections in Technology and Applications (Washington, 
D.C.: National Academy Press, 1988) pp. 47-49. 



will be parallel and some will be nonpar allel. 
A supercomputer consultant recently ana- 
lyzed the performance of different types of 
supercomputers with different combinations 
of parallel and nonparallel computation. 22 
The analysis in Figure 3 compares the simu- 
lated performance of different supercomputers 
as the problem to be solved becomes more par- 
allel 

The analysis shows that, for several of the 
most common models of supercomputer, the 



22. This section is based on Peter Gregory, "Will MPP (Mas- 
sively Parallel Processing] Always Be Specialized?** 
Supercomputing Review (March 1992), pp. 28-31. Ap- 
pendix B of this report presents the formula used in the 
calculations. A similar point is made in Patterson and 
Hennessey, Computer Architecture, p. 576. 
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vector supercomputers are faster than mas- 
sively parallel supercomputers unless as much 
as 99.2 percent-depending on the computer- 
of the computations are performed in parallel. 
That is, even if only 8 of every 1,000 computa- 
tions performed in the course of solving a prob- 
lem are not performed in parallel, then the 
vector supercomputer will be faster. 

Another major issue in the speed of parallel- 
ism is the length of time required to commu- 
nicate between nodes versus the length of time 
it takes to perform the work. Problems that 
require either relatively little communication 
between nodes or communication only to a few 
nodes are especially appropriate for parallel 
computation. But problems whose solution 
has many interactive parts are more difficult 
for parallel computers because the computers 
spend their time communicating between the 
nodes rather than computing within the 
nodes.23 

The difficulty of internode communication 
further complicates the issue of parallelism: 
not only must the problems be massively par- 
allel, but they must also have a certain type of 
parallelism, one in which the different compo- 
nents are fairly independent. One obstacle for 
parallel supercomputers is that whole cate- 
gories of problems most commonly solved on 
supercomputers have low degrees of parallel- 
ism and require a high degree of communica- 
tion between nodes.24 

Thus, theoretical maximum speed may not 
be a helpful guide to actual operations. In 
benchmark tests conducted at NASA's Ames 
Research Laboratory, the actual performance 
of several brands of massively parallel super- 
computers across a wide range of problems 



23. Robert Pool, "Massively Parallel Machines Usher in 
Next Level of Computing Power," Science, April 3, 1992, 
p. 50. 

24. Furtney and Taylor, "Of Workstations and Super- 
computers" p. 68. 

25. See David Bailey, "Experience with Parallel Computers 
at NASA Ames," Technical Report RNR-91-007 (NASA 
Ames Research Center, November 14, 1991); David Bai- 
ley and others, "NAS Parallel Benchmark Results," 



proved to be between 1 percent and 5 percent 
of theoretical peak efficiency.25 In most prob- 
lems, the massively parallel supercomputers 
were able to obtain only a fraction of the speed 
of the older vector supercomputer, in many 
cases not even matching the efforts of an older 
Cray's processor. Interestingly, the latest gen- 
eration of massively parallel supercomputers 
has closed in on the performance of an older, 
single-processor CRAY Y-MP for several 
benchmarks, a feat that largely eluded the 
earlier generations. 

The NASA analysis found, however, that 
because of the lower purchase price of mas- 
sively parallel supercomputers, the best of 
them exceeded the best vector supercomputers 
on a cost-performance basis. In addition, some 
Department of Energy researchers concluded 
that at least part of the lower performance of 
the massively parallel supercomputers was at- 
tributable to their immature software tools, a 
weakness HPCC intends to correct. 26 

The common wisdom in the supercomputer 
industry is that a new computer system has to 
be 5 to 10 times as fast (or cost-effective) as the 
old one to justify the costs of adapting to the 
new technology. In the absence of such a cost 
differential, the massively parallel supercom- 
puters will replace vector supercomputers on- 
ly slowly, if at all. Massively parallel super- 
computers exhibit this differential in only a 
small number of applications. 

Software for Vector Supercomputers. The 
vast majority of problems solved today on su- 
percomputers are solved on vector supercom- 
puters, not massively parallel supercomput- 
ers. For the past 20 years, scientists and en- 
gineers have written and optimized their pro- 
grams for these vector computers, so that 
there is now a large stable of mature software 



Technical Report RNR-92-002 (December 7, 1992). For 
similar results, see Olaf Lubeck, Margaret Simmons, 
and Harvey Wasserman, 'The Performance Realities of 
Massively Parallel Processors: A Case Study** (Los 
Alamos National Laboratory, Loa Alamos, New Mexico, 
June 19, 1992). 

26. Lubeck, Simmons, and Wasserman, The Performance 
Realities of Massively Parallel Processors. 1 * 
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able to solve a wide variety of problems. 27 
Most of this software is continuously being up 
graded and refined to improve its performance 
and make it easier to use. 

A recent survey at the Pittsburgh Super- 
computing Center indicated that their library 
had more than 300 third-party software pro- 
grams for their vector supercomputer but only 
two such software packages for their mas- 
sively parallel supercomputer.28 As a result, 
their vector supercomputer was oversub- 
scribed, and their massively parallel super- 
computer was underused. 

Existing software would have to be rewrit- 
ten in order to run on massively parallel su- 
percomputers. Some of it can be easily rewrit- 
ten, but much cannot. In fact, some of the 
most popular software for supercomputers is 
likely to be difficult to translate. The tech- 
nical software written for supercomputers can 
involve thousands of lines of code. Moreover, 
those programs must not only be rewritten but 
also optimized for the new computer architec- 
ture. (This rewriting assumes that HPCC's 
software effort is successful in producing soft- 
ware tools and techniques for massively par- 
allel supercomputers. If robust software tools 
are not developed, such rewriting may not 
take place. 29 ) 

Even if the software code is rewritten, there 
is no guarantee that it will improve perfor- 
mance. For some kinds of problems the mas- 
sively parallel supercomputers are fast, but 
for others they are not as fast as vector super- 



27. For a list of more than 600 software applications for vec- 
tor supercomputers, see "Directory of Applications Soft- 
ware for Cray Research Supercomputers" (Cray Re- 
search. Mendata Heights, Minn., 1990). 

28. Frank Wimberly, "Connection Machine Software Pack- 
ages Becoming Available" Pittsburgh Supercomputing 
Center News (May/June 1992), p. 7. Third-party soft- 
ware is software that has been written by neither the 
manufacturer nor the user of the supercomputer. Third- 
party software is typically intended for sale. 

29. The General Accounting Office recently argued that 
ARPA was neglecting the development of software tools. 
See General Accounting Office, Advanced Research 
Projects Agency Should Do More to Foster Program Goals 
(May 17, 1993). 



computers. Even if they are faster than con- 
ventional supercomputers, they may be only 
modestly faster-by a factor of two or some 
small number -which would appear to limit 
the incentives to rewrite software for them. If 
rewriting several hundred thousand lines of 
code only halves computation time, such an in- 
vestment would probably not be worthwhile 
given the relative costs of computer time and 
programmer time. The current code, although 
not perfect, may be "good enough." 

This obstacle should not be underestimated. 
In most other computer markets, a backlog of 
existing software usually gives incumbent 
computer designs a substantial, if not insuper- 
able, advantage. For example, most users 
would not switch from an IBM-compatible per- 
sonal computer even though the leading alter- 
native is commonly described as "friendlier." 
In technical markets, an investment in cur- 
rent software may weigh less heavily because 
so many users write their own software, al- 
though it is unlikely that this completely off- 
sets the advantage of having a library of exist- 
ing applications. 

Economic Inertia and Technology Devel- 
opment. Technological conservatism is seen 
everywhere in the computer world. A familiar 
example is the QWERTY keyboard, the con- 
ventional alphanumeric keyboard on virtually 
every typewriter and computer terminal. 30 
More productive keyboard layouts have been 
available since the 1930s, but have never 
caught on, even though they could easily pay 
for themselves and the retraining costs in en- 
hanced typing productivity. Typists have lit- 
tle incentive to learn a new layout until it be- 
comes prevalent, while any business that in- 
troduced a new system would have to retrain 
its entire staff. 

Tendencies toward technological conserva- 
tism may be gradually overcome, but only if 
there is a clear reward for doing so. The origi- 
nal CRAY 1 overcame such obstacles by pro- 



30. Paul David, "Clio and the Economics of QWERTY," 
American Economic Review (May 1986), pp. 332-337. 
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viding fast performance when it was intro- 
duced in 1976. The massively parallel proces- 
sors have not yet been able to match current 
supercomputers for most applications, so that 
there is no clear reward for investing in them. 
For most applications, existing supercomput- 
ers are adequate. 

In some commercial applications, where 
there may be clear rewards for rewriting soft- 
ware code, massively parallel supercomputer 
technology may penetrate first. The simula- 
tion of oil reservoirs, for example, is more ac- 
curate on parallel machines, and the problems 
involved in the simulations lend themselves to 
such technology. Moreover, from an economic 
standpoint, coming up with an accurate esti- 
mate of the size of an oil field carries a sub- 
stantial payoff. The contracts for oil produc- 
tion can be in billions and tens of billions of 
dollars. Even a small improvement in the es- 
timate can easily pay for the rewriting ef- 
fort. 31 Another example involves financial 
calculations for certain investment instru- 
ments for which the rewards can be large and 
immediate. Whether these isolated instances 
of commercial use can be turned into larger 
markets is as yet unclear. 

Other applications, such as rational drug 
design and computational chemistry, may pro- 
vide openings for massively parallel super- 
computers because they are so new that vector 
supercomputers have not yet been applied to 
them to a great extent. Consequently, inves- 
tigators can start from scratch without worry- 
ing about leaving behind a lifetime's work. 

Potential Entry into Business 
Computer Markets 

One way to move massively parallel technol- 
ogy into general use despite the preemption of 
much of its potential market by the worksta- 
tion and the vector supercomputer may be to 



31 . Ironically, simulation of oil reservoirs is often mentioned 
as a problem that is especially well suited for networks of 
engineering workstations, as discussed above. Thus, two 
types of technology will be competing for the same set of 
problems. 



shift from the technical market to the business 
market. Recently, a leading manufacturer of 
massively parallel supercomputers-Thinking 
Machines Corporation-announced its interest 
in providing "back end" power for mainframe 
computers.32 i n such a system, a massively 
parallel supercomputer would supplement the 
power of a conventional mainframe when ac- 
cessing large data bases. Other, smaller pro- 
ducers of tjhese supercomputers have posi- 
tioned their product similarly. As an adjunct 
to a mainframe, massively parallel supercom- 
puters would not conflict directly with conven- 
tional supercomputers. But like the vector fa- 
cilities discussed above, they might be able to 
create a niche by exploiting weaknesses in cer- 
tain computer markets. 

So far, the commercial sales of massively 
parallel supercomputers have been largely for 
a special or single purpose. In a widely publi- 
cized sale, American Express bought two 
CM-5 massively parallel supercomputers from 
Thinking Machines Corporation to reduce the 
time it took to query its massive data base. 
Even in this case, however, the CM-5s are not 
acting independently but in conjunction with 
a mainframe computer. 33 

One special-purpose massively parallel 
computer made by the Teradata unit within 
NCR has made substantial inroads into busi- 
ness markets over the last decade. 34 (Because 
Teradata computers lack specialized num v ^r- 
crunching capacity, they are not properly con- 
sidered supercomputers.) This line of ma- 
chines combines between several dozen and 
several hundred of the microprocessors that 
power IBM-compatible personal computers 
(the so-called 80286, 80386, and 80486) into a 
facility that runs a specialized data-base ap- 
plication, again as an addition to a general - 
purpose mainframe computer. Teradata's 



32. Johanna Ambroaio. "Super CPU Maker Widens Aim," 
Computerworld (October 19, X 9921, p. 6. 

33. Dwight Davis, "Supercomputers Knock at IS Doors." 
Datamation (December 1, 1992), pp. 79-82. 

34. Dwight Davis. "Oracle's Parallel Punch for OLTP [On 
Line Transaction Processing!." Datamation (August I. 
1992\ p. 67. 
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sales in this specialized market almost equal 
the combined sales of all the massively par- 
allel supercomputer producers. IBM recently 
announced its intention of entering this mar- 
ket of specialized parallel data-base comput- 
ers^ A major software company, Oracle, has 
also devoted substantial efforts to rewriting 
its software for several brands of massively 
parallel supercomputer to serve this market. 
For its part, Teradata has been trying to ex- 
pand its market beyond its specialized one. 

It is not yet clear whether the data-base 
market has a path that will lead to general- 
purpose commercial computing. Such a path 
might emerge as more and more functions are 
incorporated into the specialized computers 
until eventually they become general-purpose 
computers. This path might be more likely to 
penetrate the business markets than one di- 
rectly through the supercomputer market be- 
cause most U.S. firms do not use supercom- 
puters in their business. A survey of Fortune 
500 firms found that only 15 percent of them 
use supercomputers, and an additional 6 per- 
cent consider them an option. 36 By contrast, 
data-base management accounts for 50 per- 
cent of corporate mainframe use, and almost 
all Fortune 500 firms have mainframes. 

Thus, to the extent that parallel business 
computers use HPCC technology, it might en- 
ter mainstream commercial uses through al- 
ternative avenues. Like the massively par- 
allel supercomputers, however, the software 
problems associated with turning these spe- 
cial-purpose computers into general-purpose 
computers are substantial. Also, because the 
levels of technical competence are lower in the 
business market than in the scientific and 
technical markets, the effect of these software 
problems on demand is likely to be more se- 
vere. And many of the same questions regard- 
ing parallelism discussed above in connection 



35. Laurence Hooper, "IBM to Push New Generation of 
Mainframes" Wall Street Journal, December 22, 1992, p. 
A3. 

36. Mohammad Amini, 'The Status of Supercomputing in 
Corporate America," Supercomputing Review (Septem- 
ber 1991), pp. 40-41. 



with massively parallel supercomputers 
would also apply to these parallel mainframes, 
although data-base management is inherently 
very parallel. 

Obstacles in Perspective 

HPCC is not unique in facing obstacles in the 
marketplace. Most new products and many 
new technologies fail to gain widespread ac- 
ceptance when first introduced. Even when 
they finally succeed, it may be for reasons the 
inventors could not have foreseen. For exam- 
ple, the creation of small personal computers 
stimulated the demand for large flat-panel 
displays. These had been invented in the 
1960s to service a home TV market that did 
not materialize. Their inventors could not 
have foreseen laptop computers. 

The designers of massively parallel super- 
computers hope to increase the demand for 
supercomputers by making their hardware 
less expensive. But the software for these ma- 
chines, when it exists, is difficult to write and 
difficult to use. Viewed from the perspective 
of the costs of a supercomputer over its life- 
time in actual use, the massively parallel 
supercomputer reduces the cost of the least ex- 
pensive element (initial purchase price) while 
increasing the cost of the most expensive ele- 
ments (software and support). 

Firms introducing products based on HPCC 
supercomputer technology may be able to 
overcome these obstacles, although the result- 
ing market is not likely to experience the 
automatic growth of a new market. It is not 
merely a case of waiting until sufficient ap- 
plications are written for massively parallel 
supercomputers and all the kinks are ironed 
out. The target it seeks to hit is moving: both 
workstation technology and vector supercom- 
puter technology are improving. 

Most important, as noted above, most ana- 
lysts agree that computer technology is likely 
be parallel in the future. They disagree about 
how best to get there and how parallel is par- 
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allel. HPCC has positioned itself toward one 
end of the spectrum. 

The presence of these obstacles does not 
mean that there will be no market in the near 
term for such massively parallel supercom- 
puters: the analysis found two potential mar- 
kets. Rather, the obstacles will serve to limit 



demand within those potential markets. 
Overcoming some of these obstacles is a goal of 
the HPCC program. Other obstacles may be 
overcome by the firms that actually sell pro- 
ducts incorporating HPCC technology. How 
these firms position themselves in the market 
will be crucially important, but is beyond the 
scope of this report. 
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In addition to its effect on the research 
and education communities, the High- 
Performance Computing and Commu- 
nications program may also have a significant 
impact on the emerging data communications 
markets in the United States. The commer- 
cial markets currently consume most of the 
billions of dollars worth of network equip- 
ment and data communications services the 
U.S. industry produces every year. Conse- 
quently, they are likely to be among the early 
consumers of the network technology devel- 
oped under HPCC. 



HPCC and Computer 
Networks 

The National Research and Educational Net- 
work, discussed in Chapter 2, is a central part 
of the HPCC, both as a goal in and of itself and 
as an enabling technology for other compo- 
nents of the program. The aim is to make the 
network available to more researchers and al- 
so to enable it to transmit data at the rate of 1 
billion bits (1 gigabit) per second (it currently 
operates at about 45 million bits per second). 
By linking supercomputers and other research 
assets of the government over very rapid com- 
puter networks, federal agencies should be 
able to bring the best tools to bear on the 
grand challenges. In addition, the NREN 
could demonstrate how other segments of 



society might use and benefit from such a net- 
work. 

As noted in Chapter 2, the NREN compo- 
nent of HPCC has two major subcomponents: 
upgrading the interagency interim NREN, 
and promoting the development of computer 
networks that transmit data at the rate of 1 
billion bits per second. Upgrading interim 
NREN has several parts. The main focus of 
the Internet program has been on bringing the 
existing NSFNET up to 45 million bits per sec- 
ond speed. NSFNET is a computer network 
supported by the National Science Foundation 
that serves as the central link of Internet. Re- 
cently, the NSF published a solicitation to bid 
on upgrading the NSFNET to 155 million bits 
per second speed, with an eye toward eliminat- 
ing the federal subsidy on part of it. Less well 
known are efforts to bring some specialized 
agency data bases on line to make them acces- 
sible from the NSFNET. 

In another part of the interim NREN, the 
Department of Energy is accelerating develop- 
ment of the Energy Sciences Network-the 
computer network for the department's R&D 
facilities-beyond the capabilities of the rest of 
the interim NREN. DOE had selected a con- 
tractor for the development of a 622 million 
bit-per-second network for service among a 
dozen or so nodes on the Energy Sciences Net- 
work, using protocols that have only recently 
entered commercial trials. However, the Gen- 
eral Accounting Office set this selection aside 
and the contract will have to be rebid. 
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The research and development component 
of the NREN largely focuses on so-called giga- 
bit test beds. 1 These test beds are a pub- 
lic/private venture in which industry teams 
and government researchers develop and test 
components, protocols, and other aspects of 
networking technology. As technology is 
proved, it will be incorporated into the con- 
struction of the interim NREN and into com- 
mercial offerings. In the test beds, the federal 
government has leveraged its investment sev- 
eral times over with private participants: 
while the federal cost is projected to be 
roughly $15 million, the private investment is 
reported to be many times that. 

Meeting Goals 

The network component of HPCC is more dif- 
fuse than the supercomputer R&D component 
because part of the effort is involved in R&D 
and part in developing an existing network. 
Each needs to be judged by different criteria. 
The R&D component obviously needs to be 
judged primarily by technical standards. 

Technical criteria, however, are not suffi- 
cient for evaluating a network; marketing and 
demonstration criteria also need to be taken 
into account-for example, growth in the use of 
Internet. The combination of R&D programs 
with an operating network is intended to 
make computer networks faster and to dem- 
onstrate to more people that computer net- 
works can contribute to their work, education, 
and other aspects of their lives. 

Network R&D and especially Internet are 
intended to encourage the rapid spread of com- 
puter networks throughout the economy. Like 
telephones and FAX machines, computer net- 
works become more valuable as more people 
hook up to them. HPCC planners hope that as 
the capacity becomes more widely available, 
more sectors of the economy will become 
linked by computer and will invent and dis- 
cover new ways of using the network. 



I. Gary Stix. "Gigabit Connection," Scientific American 
(October 1990). pp. 118 and 120. 



Most computer power in the United States 
exists in unconnected islands. Even where 
computers are connected, the links are either 
isolated, as with organizational networks, or 
temporary, as with modem-based dial-up ser- 
vices. Computer networks have already dem- 
onstrated that they can provide a competitive 
advantage to companies having them. Many 
of the most successful retailing and service 
companies use computer networks as a source 
of competitive advantage. 2 

Furthering U.S. 
Competitiveness 

Advocates of HPCC believe that a prolifera- 
tion of network services could enhance eco- 
nomic performance and welfare. The competi- 
tiveness of U.S. industry would be furthered in 
several ways. First, U.S. service and retail 
companies, which already use computer net- 
works far more than other sectors, are likely 
to be the first to take advantage of any new 
network technology. Of course, if networks 
became more widely used internationally, 
U.S. firms might lose some of the advantages 
they currently enjoy relative to their foreign 
competition. 

Second, U.S. firms manufacture most of the 
large computer networks.^ Consequently,, if 
federal R&D and demonstration projects in- 
crease the demand for these networks, U.S. 
firms are likely to capture a large portion of 
that demand. Even in the market for small 
networks, U.S. firms have a disproportionate 
influence, largely because they dominate the 
markets for personal computer hardware and 
software. An offsetting factor is that computer 
networks compete with mainframe computers, 
a market in which U.S. firms are also quite 
dominant. If sales of U.S.-produced networks 



2. Thomas Ma lone and John Rockart, "Computers, Net- 
works and the Corporation/' Scientific American (Sep- 
tember 1991). pp. 128-136. 

3. National Research Council, Computer Science and Tele- 
communications Board. Keeping the U.S. Computer In- 
dustry Competitive: Systems Integration (Washington, 
D.C.: National Academy Press, 1992), p. 7. 
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increased, some of this increase would come at 
the cost of reduced sales by other U.S. corpora- 
tions, such as mainframe producers. 

HPCC proponents argue that computer net- 
works can help people in many different walks 
of life share scarce resources, reducing their 
cost and improving their quality. Examples of 
such specialized resources include services, 
such as medical expertise; or information, 
such as library catalogs; or people, such as 
teachers. 



Unlike the supercomputer component, the 
vision for the network component of HPCC is 
in line with economic trends. There is a trade- 
off, however, between performance and sales- 
very fast networks are not likely to be cheap, 
and expensive networks are not likely to be 
widely used. All users would like faster, more 
responsive networks, although most of them 
do not even begin to use the maximum tech- 
nical capabilities currently available. Advo- 
cates argue that the vsry presence of such ca- 
pabilities will lead to new applications, but 
critics maintain that new applications may 
not be economically viable or may not find 
wide use outside a few specific sectors. 

Regulation-particular ly if the regulation is 
dispersed among numerous state public utility 
authorities with many diverging objectives- - 
may retard the adoption of advanced network 
technology. Although the general trend of 
regulatory intervention seems favorable in 
many ways, the regulated carriers will need 
time to adjust their behavior and to put the in- 
frastructure in place. 



Analysis of the Markets 
for Computer Network 
Hardware, Software, and 
Services 

The United States has a very large and thriv- 
ing data communications market. Some ana- 
lysts believe that data transmission amounts 
to a substantial part of all U.S. telecommuni- 
cations. Many large companies are in the 
business of providing the hardware, connect- 
ing lines, software, and services for computer 
networks. 

Market Segments 



Boxl. 
Segments of the Market 
for Networking Products 

The market for computer network products 
and services can be divided into four overlap- 
ping segments. While hardware and software 
are generally complementary, network ser- 
vices are generally in distant competition 
with hardware and software. 



Hardware 

File Servers 
Cabling 

Network Interface Cards 
Bridges and Routers 
Leased Lines 



Software 

Operating Systems 
Applications 



Services 

Value Added Networks 
Outsourcing 
Switched Networks 



Internetworking 
Internet 

Commercial Providers 



SOURCE: Congressional Budget Office. 



The market for computer networks comprises 
four partially overlapping segments (see Box 
1). The first two segments consist of providers 
of the hardware and software for computer 
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networks, including telephone companies that 
lease lines over which private firms run their 
computer networks as well as firms that man- 
ufacture network hardware or write network 
software. According to the Department of 
Commerce, worldwide sales of computer net- 
work hardware and software exceeded $8 bil- 
lion in 1991. 4 Dataquest, a market research 
firm, estimates that spending for digital pri- 
vate lines increased from less than $1 billion 
in 1986 to more than $3 billion by 1990-an 
annual increase of roughly 25 percent. 5 

Firms in the third segment provide network 
services to companies, organizations, and indi- 
viduals who do not wish to set up their own 
networks. This set of firms is in distant com- 
petition with the first two, just as restaurants 
are in distant competition with grocery stores. 
The Department of Commerce estimates that 
the U.S. market for the most common single 
type of commercial network service-value 
added networks-reached $6 billion in 1991.6 
The market for another popular type of ser- 
vice, called outsourcing (in which one firm 
contracts with another to manage its com- 
puter network), is estimated to be from $3.5 
billion to $7 billion annually. By contrast, the 
market for simple switched network services, 
comparable with switched voice telephone ser- 
vice, is still in its infancy. 

The fourth segment has one principal 
member-Internet, a federally funded group of 
networks associated mainly with universities 
and research organizations. Logically it is a 
subset of the third (network) segment, but it is 
now too large to be treated on a par with com- 
mercial providers of network services. Unlike 
those providers, Internet is not a single net- 



4. Department of Commerce, 1992 U.S. Industrial Outlook 
(1992), p. 27-18. Spending on mode ma uaed by comput- 
ers to connect to networks is not included in the network 
market data discussed here. The market for modems ex- 
ceeded $900 million in 1991. 

5. "Dataquest Market Statistics: Long Distance Telephone 
Services" (Dataquest, Inc., San Jose, Calif., May 1991), 
p. 2. Much of the private-line usage is for private voice 
networks, but this is decreasing relative to the whole. 

6. Department of Commerce, 1992 U.S. Industrial Outlook, 
p. 28*8. The Congressional Budget Office found no es- 
timate of the total market for network services. 



work but a network of networks: it serves net- 
work providers directly and final users indi- 
rectly through the networks to which they be- 
long. 

Internet and the Development of 
the Network Services Market 

Internet is a network of computer networks 
serving the education and research communi- 
ties, all of which use the same protocol (TCP/ 
IP, for Transmission Control Protocol/Internet 
Protocol) to communicate. This network is an 
outgrowth of the ARPANET. Internet has 
three tiers: national NSFNET links regional 
midlevel networks, which in turn link local re- 
search and university networks. Other fed- 
eral agencies* networks are also connected to 
many of the research and educational commu- 
nities, but such connections are specific to dif- 
ferent agency missions. The contractor that 
runs the facilities for the National Science 
Foundation is a joint venture of IBM, MCI, 
and Merit, the Michigan-based midlevel net- 
work. Although the NSFNET provides the 
upper-level connections, the entire agglomer- 
ation of connections and networks is com- 
monly called Internet (see Figure 4). 



Figure 4. 
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SOURCE: Congressional Budget Office. 



NOTE: NSFNET = National Science Foundation computer 
network. 
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Figure 5. 

History of Internet Traffic 1988*1993 

Millions of Packets of Computer Information 
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July January January January January January 
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SOURCE: Congressional Budget Office from data provided by Merit/NSFNET, Ann Arbor, Michigan. 



Although the growth rate of traffic on 
Internet indicates that it is currently fulfilling 
a role in research and education, this is only a 
fraction of its potential use. A major question 
is whether delivering enhanced services to so- 
phisticated users is more important than 
broadening usage to the less sophisticated. 

Background. Internet has achieved a very 
high rate of growth during its five years under 
the current contractor. 7 When it began oper- 
ating in July 1988, the NSFNET backbone 
traffic was well under 100 million packets of 
computer information delivered electronical- 
ly. In August 1992, the NSFNET backbone 
delivered 16.5 billion packets of computer in- 
formation (see Figure 5). Similarly, the num- 
ber of networks connected to NSFNET world- 



7. Information on growth and usage of NSFNET come from 
MERIT Network. Ann Arbor, Michigan. 



wide has risen dramatically- from 350 in Jan- 
uary 1989 to 9,100 in 1993. The immediate 
success of Internet is in marked contrast to 
that of other parts of HPCC. 

The uses of the NSFNET backbone are simi- 
lar to those of other computer networks: elec- 
tronic mail and file exchanges account for al- 
most three-quarters of the data transmitted. 
These have been a decreasing share of the to- 
tal, however, although no single other use is 
displacing them. 

Despite its popularity, Internet presents ob- 
stacles to some users. Individuals not affili- 
ated with a research firm or university may 
have difficulty obtaining access to the net- 
work. Security is also a concern to many po- 
tential members that are research firms. Po- 
tential users are put off by the unavailability 
of addresses of potential correspondents: pro- 
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grams for electronic white pages are still be- 
ing developed, as is a directory of services. 
Within universities, many faculty and re- 
search staff members are unaware of having 
access to Internet or, if aware, may be intimi- 
dated by it (for example, users must learn yet 
another layer of software). Training on how to 
use Internet is limited. 

Nevertheless, a remarkable number of us- 
ers log on regularly. Internet offers access to 
electronic message boards and journals. Pro- 
fessional academic societies have mailing lists 
that permit members to exchange information 
rapidly, often serving as a grapevine in "hot" 
research areas. 

Impact on Commercial Markets. Internet 
has already had a substantial effect on the 
commercial networking market. It specializes 
in internetworking, that is, connecting differ- 
ent networks. When the first contract for the 
NSFNET was signed in 1987, the internet- 
working market barely existed. Now, how- 
ever, the number of networks has multiplied, 
and companies and groups investing in them 
want interconnections, rapidly creating a sub- 
stantial market for appropriate hardware and 
services. In fact, the market for internetwork- 
ing hardware exceeded $700 million in 1991. 
As one of the first providers of internetwork- 
ing services to a large community of users, 
Internet was in a position to help define stan- 
dards and protocols and develop the generic 
technology that would see wider use. 

Internet already provides network connec- 
tions to a substantial fraction of the users and 
developers of technology in the United States. 
In addition to universities and research insti- 
tutions, many technology companies also have 
Internet connections directly or indirectly 
through a commercial service provider. Be- 
cause networks become more valuable as more 
people connect to them, this particular net- 
work is becoming the core of a nationwide data 
network. The major public computer net- 
works-such as Compuserve and MCI Mail- 
alre^Jy have Internet gateways, and the pres- 



sure to provide connections to Internet clients 
only grows as more individuals, corporations, 
and organizations join the network. Although 
many questions remain about how best to 
transfer the responsibility for Internet's non- 
R&D operations to private hands, it has had a 
major influence on the development of nation- 
wide computer network markets. 

Commercial Internetworking. Internet was 
one of the first major providers of switched 
internetworking services-that is, providing 
network capability on demand parallel to tele- 
phone communication. But the commercial 
development of switched internetworking ser- 
vices has been slow for several reasons. Be- 
cause the market for switched voice commu- 
nications is much larger than that for 
switched data communications, most of the po- 
tential providers-the regional Bell operating 
companies and the long-distance companies- 
have been slow to enter it. Standards have al- 
so been slow to develop. Finally, the number 
of computer networks needing to be intercon- 
nected has not been very large until recently.^ 
In these circumstances, Internet provided ser- 
vices for a stable pool of customers. 

The most rapidly growing type of switched 
networking service, called frame relay, still 
has quite a limited market, and most others 
are still in trials or even awaiting them.9 The 
NSFNET contractor is in fact involved in some 
of these trials, separate from its contract with 
NSFNET but using many of the same facili- 
ties. A very important contribution of Inter- 
net, particularly the NSFNET, may have been 
in allowing the contractor-especially its joint 
venture members, IBM and MCI-to develop 
expertise in providing switched internetwork- 
ing services ahead of other firms that did not 
have a built-in clientele. 



8. Eliaabeth Horwitt, "Answering Users' Interconnectivity 
Needs," Computerworld (March 30, 1992), pp. 69 and 72. 

9. One recent survey found that as of September 1992, 
there were only 189 frame relay customers in the United 
States. Nathan Muller, "What Doea Frame Relay Really 
Cost?" Datamation (December 1, 1992), p. 58. 
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Obstacles to Wider Use of 
HPCC Technology 

What is the potential demand for switched ser- 
vices at speeds above 45 million bits per sec- 
ond? Current commercial technology can 
serve at speeds below that. No one expects the 
market to jump from 45 million to 1 billion 
bits per second. Some designs are already run- 
ning at 155 million and 622 million bits per 
second. This additional capacity may be 
shared by a number of users, none of whom 
might require all of it. 

Unlike the massively parallel supercom- 
puter technology discussed in the previous 
chaptev, the technology being developed and 
tested in HPCC gigabit test beds has clear po- 
tential for influencing mainstream data com- 
munications technology. The participating 
companies are reportedly testing switches 
that may then become the basis for commer- 
cial offerings, although probably operating at 
sub-gigabit speeds. 

Similarly, Internet has helped the demand 
for internetworking services to jell. As this 
market develops further, Internet technology 
and modes of operation, not to mention Inter- 
net itself, may become the heart of further de- 
velopments. 

Most analysts believe that a large market 
for rapid data communications will ultimately 
develop. The disagreements are about the 
path and the pace. Is the large market more 
likely to be achieved by creating many net- 
work applications that each need only a small 
network capacity and by allowing the evolu- 
tion of their needs to create a large demand for 
rapid services? Or is it more likely to result 
from creating requirements, and equipment to 
serve the most demanding requirements, 
which are relatively few in number? 



Telephone Companies and the 
Price of Leased Telephone Lines 

The data communications market as a whole 
is growing quite rapidly, probably as a result 
of the rapid proliferation of computers and the 
substantial decline in the cost of network 
equipment. Because of these changed circum- 
stances, new network services may achieve 
the commercial success that eluded network 
services in the 1970s and 1980s. It is not only 
a question of new technical capabilities, but 
also of price. 

An analogy may be seen in the way falling 
computer prices stimulated the demand for 
computers. In 1970, when the IBM 370 was 
being sold for several million dollars, the de- 
mand for it was large for the time, but minus- 
cule in comparison with today's sales figures. 
Currently, IBM-compatible personal comput- 
ers, which have roughly the same computa- 
tional capabilities as the IBM 370, sell by the 
millions for under $2,500. There have been 
some increases in computational power to be 
sure, but they are far outweighed, especially 
at the lower end of the price spectrum, by de- 
creases in price. 

If the HPCC program leads to similar de- 
creases in the cost of data communications, 
more and more commercial uses will be found 
for them. Until quite recently, communica- 
tions costs had not matched computation costs 
in their decline. 10 One recent analysis sug- 
gests that, through 1980, communications 
costs had declined between 3 percent and 5 
percent a year, but that computing costs were 
falling more than 20 percent per year during 
this same period, even though major pieces of 
computing equipment and communications 
switching equipment share many compo- 
nents. 11 



10. This analysis is from Kenneth Flamm, "Innovation, Reg- 
ulation and Competition," in Robert Crandall and Ken- 
neth Flamm, eda. t Changing the Rules: Technological 
Change, International Competition, and Regulation in 
Communications (Washington, D.C.: Brookings Institu- 
tion, 1989), pp. 13-61. 

11. Ibid., p. 29. 
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The trajectory of costs in the future, how- 
ever, will crucially depend on the market 
structure. The above-cited analysis argued 
that it was not lack of investment or R&D that 
kept communications prices from falling as 
rapidly as those of computers, but rather regu- 
lation and lack of competition. Providers of 
network hardware, however, are in a highly 
competitive market. With the breakup of the 
Bell system, there is now competition in the 
long-distance market, and so some prices of 
leased digital long-distance lines, as discussed 
below, have fallen. 

Local Leased Telephone Lines. The local 
telephone companies still have near-monopoly 
control over local access, which the nationwide 
providers of leased lines and network services 
need in order to reach their customers. The 
prices local telephone companies charge these 
providers may not drop sufficiently to encour- 
age a large market. 

Nonetheless, some providers of alternative 
services have bypassed local service providers 
and may be in a position to force competitive 
reactions from the local telephone companies 
in some areas. How much discretion the local 
companies will be allowed will depend crucial- 
ly on the actions of regulatory agencies. The 
regulatory climate seems favorable for encour- 
aging competition overall, but a fully competi- 
tive market may be slow to emerge and may 
take years to develop nationwide. The slow 
development of alternative providers may al- 
low local providers a substantial degree of pro- 
tection from the hazards of competition and 
enable them to hold onto a sizable chunk of the 
entire commerce in this area. 

As noted above, private leased lines are a 
major element in the data communications 
market, especially at faster speeds. Local tele- 
phone companies have not lowered their prices 
for these lines significantly. According to fil- 
ings with the Federal Communications Com- 
mission (FCC), the Bell operating companies' 
prices for data services averaged a 2 percent 
annual decline between July 1990 and July 
1992 (the most recent data available). 12 Al- 
though some local exchange carriers had larg- 



er declines, none had annual declines larger 
than 5 percent. 

Local carriers still account for the vast ma- 
jority of private lines. According to one esti- 
mate, they provided 80 percent of all private 
lines in 1989.13 Two-thirds of all data lines 
were local, at least 90 percent of which were 
provided by local exchange carriers. The local 
metropolitan fiber systems, satellite systems, 
and other systems still accounted for only a 
small fraction of leased data lines. According 
to FCC data, these alternative local carriers 
together served fewer than 6,000 customer lo- 
cations nationwide at the end of 1991.14 

Long-Distance Leased Lines. Interex- 
change (or long-distance) carriers as a group 
accounted for roughly 20 percent of leased da- 
ta circuits in 1989, according to the previously 
cited survey of private lines. Their percentage 
has probably risen since then. Though more 
competitive than the local exchange carriers, 
American Telephone and Telegraph still ac- 
counts for the bulk of this business. 

The interexchange carriers, in contrast 
with local exchange carriers, seem to have 
brought some of their prices on leased lines 
down substantially. Most important, in posted 
prices filed before the FCC, there is no domi- 
nant single price trajectory. Posted prices for 
short-range private lines, where the inter- 
exchange carriers compete with the local ex- 
change carriers, have not fallen and in some 
instances may have risen since 1990. In the 
highly competitive longer-distance (above 200 



12. The data are taken from the individual company Tariff 
Review Plans using the Special Access Basket lines 
detailing High Capacity and DDS (Dedicated Digital 
Service) indices. 

13. Allan Turnbill, "The Future of Private Lines'* (Probe Re- 
search, Cedar Knolls, N.J., 1989). See Chapter 13, espe- 
cially pp. 396 and 402. Private lines can carry either da- 
ta or voice traffic. Surveys and other techniques can be 
used to provide estimates of the use. 

14. Jonathan Kraushaar ."Fiber Deployment Update, End of 
Year 1991" (Industry Analysis Division, Common Car- 
rier Bureau, Federal Communications Commission, 
March 13, 1992). Table 15. 
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miles) markets, prices have been falling, al- 
though not by as much as computer prices. 

Private-line prices have a fixed monthly 
component and a mileage-based monthly com- 
ponent. While the mileage price has been fall- 
ing dramatically-by more than half in the last 
two years-the fixed component has undergone 
a dramatic rise— 20 to 50 percent since 1990. 
For short distances, the rise in the fixed com- 
ponent dominates the decrease in the mileage- 
based component. Thus, posted prices on pri- 
vate lines shorter than 200 miles have risen, 
while posted prices on longer private lines 
have fallen, with coast-to-coast posted prices 
falling most. By way of illustration, the post- 
ed price for a 1,500,000 bit-per-second leased 
line roughly the distance from Chicago to New 
York (700 miles) fell by an average of 13 per- 
cent per year between 1990 and 1992, while 
prices for leased lines 75 miles long have risen 
by an average of 7 percent per year. 

The posted prices are subject to volume dis- 
counts, commitment discounts, and other dis- 
counts depending on private negotiation. 
Such discounts serve the larger customers the 
best. The consumer who is least likely to 
benefit from such arrangements is a regional 
business or organization that wishes to tie to- 
gether only a few sites: neither the local- 
exchange carriers nor the interexchange car- 
riers have reduced posted prices in that mar- 
ket substantially. 

Data communications prices may come 
down if consumers buy switched network ser- 
vices rather than lease private data lines. Un- 
der this arrangement, customers would pay 
only for the actual use, just as they do cur- 
rently for long-distance voice conversations. 15 
The local-exchange carriers have jointly com- 
mitted themselves to providing these services. 
This service is completely new for the local-ex- 
change carriers, however, and it is not clear 
how rapidly these services will displace their 



15. Muiler. "What Does Frame Relay Really Coat?" pp. 55- 
62. 



leased-line services or force those prices down 
in competition. 

The near-monopoly of local-exchange car- 
riers on local circuits, both for purely local 
transmissions and for access to interexchange 
carrier lines, is forecast to decline. Whether 
the decline will be fast enough or large enough 
to cause prices to decline is not clear. If com- 
petition is not sufficient to lower prices sub- 
stantially, then the market for data commu- 
nications may not develop as quickly as the 
computer market. 

Though central to the successful commer- 
cialization of HPCC technology, the issue of 
regulation of the telecommunications markets 
is beyond the scope of this analysis, other than 
to note the central role competition could play 
in bringing the technology to market. 

Likely Effects of Price Changes. The cre- 
ation of a substantial market usually involves 
shifts in both demand and supply. HPCC is at- 
tempting to influence both. By subsidizing 
early users through Internet, HPCC helps in- 
crease the potential uses of network technol- 
ogy and thus shifts the demand curve so that 
more people seek to use networks. The inde- 
pendent proliferation of computers similarly 
shifts the demand curve by increasing the 
number of potential users. 

For many components of networks, primar- 
ily hardware, the supply curve also has been 
shifting as the general progress in electronics 
has lowered prices. Prices of network-related 
electronic equipment have declined by a 
weighted average of 16 percent a year since 
1990, according to industry data. 16 

Although the total cost of the system and 
the network services has fallen, the price of 
one major component- the leased local data 



16. Figure calculated using U.S. prices and world market 
shares of the different types of network equipment. 
Price data from Dataquest, "Local Area Networks Mar- 
ket Share and Forecast** (May 1992); and "Networking 
Market Trends** (August 1992). Market share data from 
Department of Commerce, 1993 U.S. Industrial Outlook 
(1993). pp. 24-26 and 25-26. 
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line-has not budged, although the number of 
such lines has increased. Such lines are cru- 
cial if the widespread internetworking con- 
ceived by HPCC is to become a commercial re- 
ality. But as the other components decrease in 
cost, local data lines will come to represent an 
ever larger share of the total cost. 

Under some circumstances, HPCC technol- 
ogy could become widely used without major 
shifts in relative prices of leased lines. Com* 
puter networks may be subject to what eco- 
nomic historian Nathan Rosenberg calls 
"learning by using": as people learn to use net- 
works, they rely more and more on them, and 
the networks increase in value over time. Un- 
der these circumstances, demand may expand 
without price decreases, provided the alterna- 
tive local telephone systems also expand to 
match any capacity constraint of the Bell op- 
erating companies. 

Demand for Very Fast 
Services 

When the capacity of a network to carry data 
files is initially increased, the user sees imme- 
diate benefits. 17 Large files can be trans- 
ferred much more rapidly, for instance. But as 
the capacity of the network rises further, the 
speed of file transfers is limited not by the ca- 
pacity of the network but by other factors, 
such as the speed of light or distance. 18 Con- 
sequently, there is a point of diminishing re- 
turns to increasing network capacity. For 
modest-size files, the point of diminishing re- 
turns comes at a network capacity well below 
the gigabit-per- second level. 

To analyze the relationship between capac- 
ity and speer\ the Congressional Budget Office 
simulated the behavior of three networks of 



17. Thia analysis ia taken from Leonard Kleinrock, 'The La- 
tency/Bandwidth Tradeoff in Gigabit Networks," IEEE 
Communication* Magazine (April 1992), pp. 36-40. 

18. Light does not travel through fiber-optic networks at the 
same velocity as in a vacuum. Most fibers have an index 
of refraction of roughly 1.5, which reduces the speed of 
light by a third. 



different capacity transmitting files roughly 
the size of the average FAX halfway across the 
country. 19 FAXes were chosen because they 
are currently the most common form of data 
communications. 

At roughly 20 percent capacity use, a net- 
work of 1.5 million bits per second-roughly 
the capacity of the older Internet trunks- 
would transmit a FAX-sized file in a little less 
than a second. This rate is much faster than 
the current analog transmission speed of 9,600 
baud per second. 20 If the capacity of the net- 
work was improved to 45 million bits per 
second-the capacity of the new trunks on 
Internet-transmission would take one- 
twentieth of a second. If a 1.2 billion bit-per- 
second network was transmitting the files, 
transmission would take one-eightieth of a 
second. In this last case, a 26-fold increase in 
capacity brings only a fourfold decrease in the 
system's response time. (Appendix C contains 
the formula used in calculating these results.) 

Well before a network reaches the point at 
which there is no physical advantage to its in- 
crease in capacity, it is likely to reach the 
point at which there is no economic advantage 
either. For many users, the difference be- 
tween receiving files in one-eightieth of a sec- 
ond rather than one-twentieth of a second may 
not be worth the extra cost. 

If communications costs and transmission 
times decline, however, file size will probably 
grow in response as people are able to include 
more information in their messages. If the 
average file size grows by a factor of 10, the 
benefits of the higher speed become more ap- 
parent: at 20 percent capacity, the 1.2 billion 
bit network is almost 15 times faster than the 
45 million bit network. If the average file size 



19. Thia analysis assumes the average file on the network ia 
the size of a FAX, that ia. 1 million bits. Moat users 
would not use FAX technology to transmit data through 
a computer network because it would take too long to 
print. Actual data files are likely to be much smaller. 

20. A baud ia a measure of modern transmission speed and 
does not correspond to bits of data per second. 
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grows by a factor of 25, the faster network is 
20 times as fast. 

Thus, the commercial success of the HPCC's 
fast network technology will depend on the 
spread of applications that can make economic 
use of the capacity. Except in some obvious 
areas, such as medical imaging and video 
conferencing, such uses may be slow to become 
widely used. 

Advances in Other Areas of 
Technology 

Rapid advances in computer technology in 
other areas can temporarily substitute for ac- 
celeration of transmission speeds in several 
ways. Software and hardware designers are 
designing systems that reduce the volume of 
data that must be transmitted, using a tech- 
nology called data compression or simply com- 
pression. The effective result is the same as 
an increase in communications speed. If, for 
example, the size of a file to be transmitted is 
compressed to half its size, then the effective 
speed of communication -from the user's point 
of view-is doubled. Advances in compression 
technology have also reduced the cost substan- 
tially. In 1992, AT&T announced a set of in- 
tegrated circuits costing $400 that would per- 
form many of the same compression functions 
previously performed by printed circuit boards 
costing $25,000.21 

Electronic systems designers have substan- 
tial incentive to improve compression technol- 
ogy and already use it to allow consumers to 
defer expensive investments or increase capa- 
bilities. Several of the more popular pieces of 
personal computer software claim to expand 
the capacity of existing computer hard disks 
by compression. Similarly, the growing field 
of multimedia applications depends on com- 
pression technology. Already some experi- 
mental systems have used compression to pro- 



21. John Keller, "AT&T Unveils a Chip Set That Lets PCs 
Be Used for Video Communication," Well Street Journal, 
April 3, i992, p. B2. 



duce full-motion video over the copper tele- 
phone (twisted-pair) wires connecting most 
homes. Home trials are expected to begin 
soon. 

Compression technology has two closely re- 
lated advantages over accelerating transmis- 
sion speeds. First, it can use existing infra- 
structure. Second, it does not have to advance 
the whole system to achieve its end. Design- 
ers of compression technology can cater to se- 
lected final users without concerning them- 
selves much with the rest of the system. They 
can target high-value and specialized niches 
much more rapidly than can providers of net- 
work infrastructure, who, by definition, must 
compromise among users. To some degree, 
they can beat the network providers to the 
early, most valuable customers. 

The potential of compression technology to 
substitute for network technology has several 
limitations, however. The techniques using 
the highest compression ratios-those that re- 
duce the file to be transmitted by the largest 
percentage-currently discard part of the data. 
Some economic uses, such as video transmis- 
sions to the home, can accommodate these 
losses, while others, such as medical images, 
cannot. But even the compression techniques 
that lose data are limited in their ability to 
compress it. Although they may slow the mi- 
gration to higher network capacity, they can- 
not prevent it. 

Parts of HPCC are concentrating on com- 
pression R&D and presumably will play a role 
in increasing that technology's power and 
availability. This particular trade-off between 
different aspects of HPCC is not unique and 
can work in any direction. Depending on the 
level of technology development, software 
may be interchangeable with hardware, and 
communications capacity may be interchange- 
able with computing power. Such substitut- 
ability is common in complex technology de- 
velopment programs. 

A similar advance in electronic technology 
that reduces the need for high-speed networks 
is the splitting of electronic signals. This tech- 
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nique involves combining and splitting the 
signals that come down the transmission line, 
substituting many small channels for a single 
large one. 

The technology is quite mature and has 
been in use for a long time. When combined 
with some new technologies that shift signals 
in time (called delay equalization) and with 
changes in pricing and service structures of 
long-distance carriers, it substitutes for high- 
er transmission speeds. For instance, by com- 
bining seven 56,000 bit-per-second lines, a 
video conference system can be transmitted 
without the need for special lines. The long- 
distance carrier Sprint provides a commercial 
service (Healthcare Application Network De- 
livery System) that uses this type of system to 
transmit video conferences and medical im- 
ages. 

End users also employ these techniques to 
split a large leased line into many small lines. 
In fact, the leased lines described above are of- 
ten used not for single large applications but 
to agglomerate many small applications, even 
mixing voice and data transmissions. Some of 
this equipment also has limited switching ca- 
pacity. 

Compression techniques and splitting pro- 
vide instances in which an advance in compu- 
tational technology is substituted for an ad- 
vance in communications technology. Since 
the growth in computer technology does not 
seem to be slowing, there is substantial reason 
to believe that these and other advances may 
continue to delay the need for faster commu- 
nications technology. In both compression 
technology and splitting technology, however, 
market growth is hampered by lack of com- 
patibility and common standards. Much will 
depend on the extent to which producers can 
reach agreement. 



As noted above, computer power can be sub- 
stituted for communications power only to a 
limited extent. As computers become ubiqui- 
tous, the need to link them rises. This linking 
is likely to be guided by economic consider- 
ations, which does not mean that it will inevi- 
tably favor the consumer uses often described 
by data communications forecasters. 

Perspective on the Obstacles 
to the Development of a 
Commercial Market for HPCC 
Technology 

Obstacles to development are not insurmount- 
able. If high-speed data transmission is costly, 
firms and individuals will be encouraged to 
find ways around the expensive component or 
to make do with less. Although declining pric- 
es increase demand, so also does expansion in 
the pool of potential users. A case in point is 
the growth of local area networks that connect 
all the computers within a building or campus. 
Connecting two aggregations of computers 
and computer users is likely to be more valu- 
able than connecting individual computers 
that happen to be at great distances from each 
other. Thus, increases in the number of local 
area networks are likely to expand the de- 
mand for larger networks. 

These shaping forces are creating opportu- 
nities for entrepreneurs to make use of the 
type of technology that is being developed un- 
der HPCC. In this perspective, the scenario 
for network technology looks better than that 
for supercomputer R&D. This is not to say 
that all the firms that use HPCC network 
technology will be successful, or that none of 
the firms attempting to market HPCC 
supercomputer technology will be successful. 
The outcome will depend on events that are 
beyond the scope of this study. 
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Commercial demand is not the only rea- 
son high-performance computing and 
communications technologies are be- 
ing pursued. Federal agencies can use some 
of the capabilities of high-performance com- 
puting or communications-indeed those are 
among the primary goals of HPCC. In the 
short term, however, agency missions are of- 
ten in conflict with commercial success. Fed- 
eral agencies differ from most potential users 
of the new technologies in having more tech- 
nical expertise and being somewhat less sen- 
sitive to costs. In setting policy for HPCC, 
policymakers must decide how much weight 
to assign to each set of goals: the short-term 
goals of federal agencies and the long-term 
goals of commercialization. 

The Computer Systems Policy Project 
(CSPP), in its evaluation of HPCC, argued 
that the computing problems the program in- 
tended to address, the so-called grand chal- 
lenges, were too distant from those most peo- 
ple encounter to provide much of a demonstra- 
tion of the ways in which computer networks 
could actually help people. They proposed 
that the program focus on more mundane ap- 
plications. 

Other commentators have suggested that 
the federal government should help create this 
new information infrastructure, just as it has 
played a role in creating other components of 
infrastructure such as the Interstate Highway 
System. In this case, however, the roles of the 
federal government and private parties might 
be reversed. When the Interstate Highway 
System was built, its everyday benefits were 



apparent to anyone who drove a car or truck. 
The federal government's unique contribu- 
tions were the financial resources to build the 
highways and the legal power to get the land 
and rights of way. In the HPCC case, many 
private parties can afford to build major por- 
tions of the information infrastructure, but 
most people do not yet have a use for it. The 
appropriate federal role may be to help de- 
velop early applications of the new technology. 

In response to these concerns, the Congress 
is considering whether to expand the network 
component of HPCC. The most commonly dis- 
cussed forms of this expansion would create 
applications in four distinct areas under the 
rubric of an information infrastructure devel- 
opment program. 1 The four areas are medi- 
cine, education, manufacturing, and libraries. 

o Medicine. The National Library of Medi- 
cine would develop network applications 
for communicating medical images, such 
as X-rays and CAT (computer-aided to- 
mography) scans, by computer network; 
build test-bed networks linking hospitals 
and other medical centers to enable them 
to share data and records; and develop net- 
work applications to provide long-distance 
medical care. 

o Education. The National Science Founda- 
tion would be authorized to develop pilot 
projects to connect U.S. elementary and 



1. Several versions of this option have been introduced in 
the 103rd Congress. S. 4, introduced in January, incor- 
porates such an option as Title VI; most of this legisla- 
tion is unrelated to HPCC. H.R. 1757 and parts of H.R. 
820 also incorporate much of this expansion. 
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secondary schools to Internet and to gen- 
erate software and training materials. 

o Manufacturing. The National Institute of 
Standards and Technology would develop 
and transfer electronically networked 
manufacturing applications, including 
standards development. 

o Libraries. Both the National Science Foun- 
dation and the National Aeronautics and 
Space Administration are responsible for 
developing prototype digital libraries and 
the associated technology. NASA would 
make specialized government sensing data 
available over Internet. 

To pay for these programs, the proposals 
would typically authorize an additional $1.0 
billion to $1.6 billion over the next five years. 
If funded at the proposed level, total spending 
for high-performance computing and commu- 
nications technology would rise to between 
$5.0 billion and $5.5 billion over the 1992- 
1996 time frame, depending on when the pro- 
posal was passed, for an average of $1.0 billion 
to $1.2 billion per year. 

Aside from these Congressional initiatives, 
HPCC has shifted the focus of some research 
and development to accommodate the CSPP 
critique. For example, in choosing "grand 
challenge" supercomputing projects, the De- 
partment of Energy has begun to select 
projects that will use the high speed of the 
massively parallel supercomputer to provide 
answers to some applied research questions of 
near-term economic significance. DOE has in- 
cluded projects using computational chemistry 
to study various aspects of industrial pollution 
and alternative ways of alleviating it. An- 
other project employs computational fluid dy- 
namics to study industrial processes with the 
aim of increasing energy efficiency and lower- 
ing the output of pollutants. DOE is also fund- 
ing R&D toward the modeling of petroleum 
reservoirs and groundwater. These projects 
are in addition to the long-range ones to which 
DOE is committed as part of its grand chal- 
lenge problems, such as those involving high- 
energy physics. 



Networks and Medicine 

The medical program is designed to improve 
the use of information technology in manipu- 
lating and transferring medical information, 
from centralized recordkeeping to medical im- 
aging. The major questions regarding the 
sharing of patients' records are legal and or- 
ganizational as well as technical and eco- 
nomic: How does one organize a cost-effective 
system that allows medical personnel timely 
access to useful information, yet preserves the 
privacy of patients and satisfies the needs of 
medical organizations? 

Medical imaging is seen as an early poten- 
tial user of high-speed data transmission. 
Hospitals and medical centers have to get X- 
rays into the hands of radiologists and other 
doctors for interpretation. Other medical im- 
ages that doctors need to see on a regular basis 
include angiograms, sonograms, CAT scans, 
and magnetic resonance imaging (MRI) scans. 
(Cardiologists are already faxing electrocar- 
diogram results to colleagues for diagnosis.) 

Hospitals have been transmitting medical 
images over telephone lines to radiologists, 
who use personal computers in their offices or 
homes. In this way a team of radiologists can 
serve more than one hospital and make more 
efficient use of their time. Because ordinary 
X-rays contain so much data, they are difficult 
to transmit over phone lines. 2 Many other ra- 
diological images, for instance CAT scans and 
MRI scans, can be easily transmitted this way. 
Transmission time is slow, however, requiring 
roughly half an hour to send a complete scan. 

Because conventional telephone lines take 
so long to transmit sophisticated images, 
medical centers cannot use them for most of 
their imaging needs. A large medical center 



2. An ordinary X-ray can be converted by a laser scanner 
into an array of data 2,000 numbers wide by 2,000 num- 
bers bigh by 12 numbers deep (for shades of gray), or 
roughly 50 million bits of data. Even if the resolution is 
reduced to 1,024 by 1,024, an X-ray still has over 12 mil- 
lion bits of data. 
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at the height of its work day might produce a 
medical image every few seconds. For this 
reason, research in medical imaging has 
turned to computer networks. 

Types of Medical Imaging 
Communications 

Medical imaging transmission needs can be 
divided into two types: for local areas within 
major medical centers and, for wider areas, be- 
tween medical centers of differing sizes or 
from medical centers and hospitals to individ- 
ual doctors and small practices. The two types 
have different communications needs, and 
each is likely to find a different cost-effective 
solution. 

Local Communications. Several private 
demonstration projects have begun. For ex- 
ample, Washington University, which has a 
major radiology institute, has teamed up with 
private companies to develop a high-speed 
network to give radiologists rapid access to 
medical images.3 The objective is to create a 
network initially capable of delivering 155 
million bits per second to 128 ports, and ulti- 
mately of delivering 620 million bits per sec- 
ond to 256 ports 

Wide-Area Communications. Sprint has 
demonstrated a system for transmitting medi- 
cal images between medical centers that joins 
together Sprint's current switched services 
(56,000 bits per second). It allows customers 
to join together temporarily several low-capac- 
ity telephone lines to provide a single large- 
capacity telephone line without having to 
build new capacity to accommodate the peak 
load. 

This service permits communications be- 
tween centers that have a moderate amount of 
radiological data to transmit. For instance, 
the armed services have contracted to have a 



3. Jerome Cox and Jonathan Turner, "Project Zeus: Design 
of a Broadband Network and its Application on a Uni- 
versity Campus" (Department of Computer Science, 
Washington University, St. Louis, Mo., 1991). 



switched service so that much of their radio- 
logical work can be concentrated in regional 
centers. A small fort or post may not have suf- 
ficient demand to justify a radiologist, and for 
a center that sends relatively few images (sev- 
eral dozen a day) the cost of using dedicated 
private lines would be exorbitant. Local ex- 
change carriers are also beginning to offer 
some switched data services that allow users 
to pay only for the time the lines are in actual 
use. 

Many radiological practices and individual 
radiologists still use ordinary telephone lines, 
modems, and personal computers to transmit 
medical images. Currently available technol- 
ogy has a lot of unused potential, often be- 
cause the load does not warrant special invest- 
ments. The ultimate transmission vehicle for 
small practices is still unclear. 

Obstacles to Market 
Development 

By concentrating on medical imaging, HPCC 
may be able to avoid the fate of earlier 
telemedicine demonstration projects. Earlier 
projects were unable to show that adopting so- 
phisticated broadband telecommunications 
equipment led to significant increases in de- 
livered health care despite higher delivery 
costs. 4 Furthermore, many of the benefits 
that did occur were easily obtained using a 
telephone. Most of these early experiments in- 
volved replacing face-to-face contact between 
doctor and patient with some electronically in- 
termediated contact, whereas much HPCC re- 
search will be concentrating on efficient use of 
information within the health care delivery 
system. 

Parallel with the need for transmission of 
medical images is that of storing, cataloging, 



4. For a review of earlier efforts to use sophisticated tele- 
communications technology in the provision of medical 
services, see David Conrath, Earl Dunn, and Christo- 
pher Higgins, Evaluating Telecommunications Technol- 
ogy in Medicine (Dedham, Mass.: Artech House, 1983), 
pp. 197-217. 
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and retrieving these medical images. (These 
functions might fall under the purview of the 
library systems described below.) 

None of the current systems has proved ade- 
quate for all the uses to which it might be put. 
For example, no software exists to help re- 
searchers search through X-rays for patterns 
to help them test theories about the develop- 
ment of certain medical conditions. Such limi- 
tations have prevented the electronic storage 
of medical images from becoming as widely 
used as it might be, given the stage of hard- 
ware development. Moreover, without soft- 
ware that can electronically store, search, and 
manipulate the images, the transmission of 
medical images becomes much less valuable. 
To develop fully the market for electronic ex- 
change of medical images, these software 
problems will have to be addressed. 



Networks and Education 

Most versions of the education proposal would 
have the National Science Foundation develop 
pilot programs to connect primary and secon- 
dary schools to NSFNET and Internet, and de- 
velop software, systems, and training for 
teachers and students. Although NSF could 
develop materials and perhaps subsidize In- 
ternet connections, the ultimate responsibility 
for setting up computer networks at the local 
school level would most likely lie with state 
and local authorities, who in fact have shown 
themselves quite willing to move rapidly. 

Existing State Networking 
Programs 

Twenty to thirty states already have state - 
level computer networks dedicated to educa- 
tion. Although they vary in sophistication, 
the Texas Education Network (TENet) is often 
described as the most comprehensive. Started 
by a $1.2 million grant from the state legisla- 
ture, TENet had 13,000 accounts in the first 



year of service and was growing rapidly. 
Teachers, administrators, parents, and other 
interested people connect to TENet an average 
of 3,000 times per day. TENet provides data 
bases to help teachers develop work plans for 
their classes. Some curriculum plans have 
been developed cooperatively over the net- 
work. Matchmaker services help teachers and 
classes find correspondent teachers and 
classes to undertake joint projects-for exam- 
ple, comparing the cost of family groceries 
across the state. In addition, TENet provides 
the usual computer network services-elec- 
tronic mail, access to Internet, and file trans- 
fer. 

The Texas state legislature funded TENet 
only after a comprehensive plan had been 
drawn up to develop computer use for educa- 
tion in kindergarten through grade 12. To en- 
sure success in reaching its broad target 
group, TENet piggybacked on the Texas High- 
er Education Network that serves the state 
universities. This move reduced TENet's costs 
and ensured the expertise needed to run such 
a system. TENet had a comprehensive train- 
ing strategy to ensure that there would be a 
trained representative in every school district 
in Texas. The system administrators also 
made every effort to ensure that the network 
included information that schoolteachers 
would find of immediate interest-curriculum 
development materials, for example. They re- 
wrote software to make it easier for teachers 
to use, and made it affordable to encourage 
participation. Along with TENet, the State of 
Texas also provided $100 million to fund tech- 
nology grants to local schools to encourage 
them to buy technology training, hardware 
(including calculators), and software or educa- 
tional systems to help spread technology 
throughout the state educational system. 

Obstacles to Market 
Development 

Whatever the efforts of HPCC in developing 
applications, the trend toward extensive use of 
computer networks at the school classroom 
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level will probably be limited, at least in the 
near future, for a number of reasons. Only 
one-third of elementary and secondary school 
teachers have had as much as 10 hours of com- 
puter training^ Existing training focuses 
more on computer literacy than on how to use 
the computer in education. Most classrooms 
at the elementary and secondary level do not 
even have telephone lines. Rewiring all the 
elementary and secondary schools would be 
expensive, and most education budgets are al- 
ready under pressure. Most of the existing 
computers in public schools are not appropri- 
ate for network use and would require upgrad- 
ing or replacement. 

Despite these limitations on near-term mar- 
ket development, federal agencies may be use- 
ful in providing leadership to the states' ef- 
forts in educational technology. Although 
many school districts are conducting sophisti- 
cated experiments, progress is uneven nation- 
wide, and every state and district has had to 
relearn expensive lessons. As the main spon- 
sor of Internet, the federal government is also 
in a unique position to ensure that this re- 
source is made available to education. As use 
of computer networks becomes more wide- 
spread, schools may have to introduce stu- 
dents to computer networks in order to pre- 
pare them for their lives as adults in a net- 
worked society. 

The proposals under consideration suffer 
from several shortcomings. First, they are de- 
fined from the perspective of technology rath- 
er than education. The National Science 
Foundation, not the Department of Education, 
is the organizational locus. Policy seems to be 
focused on getting educators to use Internet 
rather than using Internet to solve the prob- 
lems educators face. 

And, unlike the Texas educational technol- 
ogy endeavor, these proposals largely fail to 
address the program's main constraint- -the 
lack of teacher training in advanced computer 



5. Lynn Olson, "Contrary to Predictions, Use of Technology 
in Schools Elusive," Education Week. Special Report 
(January 8, 1992), p. 2. 



technology. They include funding for the 
preparation of training materials, but not for 
training. 

As noted above, entering Internet is a 
daunting experience. Without training or con- 
siderable experience, most teachers will have 
difficulty using any resource available 
through the network, regardless of its quality. 
Policymakers must decide whether the use of 
technology in education would be advanced 
more by spending several hundred million dol- 
lars to develop specialized network resources 
or by training teachers to use existing net- 
work resources. 



Networks and 
Manufacturing 

Federal agencies have been trying to promote 
computer networking in manufacturing for 
years without much success. The National In- 
stitute of Science and Technology (NIST) has 
been very active in fostering several manufac- 
turing-oriented protocols for computer com- 
munications. These protocols include GOSIP, 
the government version of the OSI (Open Sys- 
tems Interconnection) protocol, and MAP 
(Manufacturing Automation Protocol), but the 
market for capital goods using these protocols 
has been very limited thus far. Commonly 
cited reasons for the market's failure to take 
off include the inability of the vendors to agree 
on standards, expensive and relatively primi- 
tive technology, and cyclical problems in the 
major industries that would use the network. 



Networks and Libraries 

By contrast, libraries are readily taking to 
computer networks. The fit is quite natural: 
networks increase both the resources avail- 
able at any library and the potential user base 
of any library. For example, one of the ser- 
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vices provided on the TENet allows Texas 
teachers on-line access to the U.S. Department 
of Education Research and Information Cen- 
ter (ERIC) data base, giving teachers in dis- 
tant communities access to much more infor- 
mation than would be available to them lo- 
cally. Since many teachers use TENet in the 
evening, having libraries on-line means that 
they need to have fewer resources at home. 
For example, TENet makes encyclopedias 
available. Many libraries also have their card 
catalog on-line. 

Similarly, the National Library of Medicine 
allows doctors to search the literature from re- 
mote locations. As in medical imaging, net- 
works and medicine have begun to work well 
together in this area. 

In addition to these public data bases, many 
private firms provide electronic data-base ser- 
vices, including many of the commercial net- 
work services discussed in Chapter 4. For ex- 
ample, Compuserve has information on airline 
schedules, and various dial-up services sell da- 
ta for a fee. Most of these services, as well as 
the public data bases, are text retrieval ser- 
vices and lack experience with the much larg- 
er data sets or protocol issues that come with 
electronic imaging. 

As noted in the medical section above, sub- 
stantial questions arise in making digital li- 
braries useful to researchers. In the medical 
area, for instance, the inability of currently 
available software to sift through medical im- 
ages according to predetermined criteria has 
limited the usefulness of networks to radiolog- 
ical research. 

HPCC is already substantially involved 
with the creation of a national storage system 
as part of NSF efforts to integrate all the re- 
sources at its supercomputer centers. This ef- 
fort includes promoting standards for filing 
systems that would be accessible by network 
and creating systems for distributed mass 
storage-that is, permitting the integration of 
data that are stored in different computers at 
different sites. Using such data requires uni- 
versally accepted conventions and protocols. 



Program Balance 

The proposals to expand the network compo- 
nent of HPCC could provide additional fund- 
ing for current programs, or they could replace 
current activities. Replacing current activi- 
ties with those suggested in these proposals 
would reduce HPCC's current focus on super- 
computer R&D and result in a more even di- 
vision between supercomputer R&D and net- 
work R&D. 

The two options reflect the unresolved ten- 
sion in the direction of HPCC. Is it ultimately 
concerned with aiding federal missions by pro- 
viding networks that link high-performance 
computers, or with developing technology to 
make computing inexpensive, communica- 
tions technology easy to use, and computers 
therefore ubiquitous? 

Until now, the fact that the HPCC budget 
was spread among different parts of the discre- 
tionary spending category mitigated this ten- 
sion and prevented it from surfacing com- 
pletely. Starting in fiscal year 1994, however, 
the Budget Enforcement Act puts all discre- 
tionary spending in a common pot. Policy- 
makers, for example, during the current bud- 
get debate can remove supercomputer R&D 
funds from the Advanced Research Projects 
Agency to pay for network R&D in the NSF, 
NIST, and NASA. Given the cuts in discre- 
tionary spending mandated by the act, policy- 
makers may have to decide which part of 
HPCC is most critical. Furthermore, the 
agencies centrally involved in HPCC— NSF 
and NASA-experienced real declines in bud- 
get authority in 1993 and v ill have to make 
internal decisions regarding the different com- 
ponents of HPCC. 



Conclusions 

The different elements of HPCC have different 
potentials. Clearly, graduate students trained 
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under the human-capital part of HPCC are 
likely to find jobs in academia where they will 
educate the next generation of computer pro- 
grammers, and in industry where they will 
write computer programs. It is less easy to 
foresee the outcome of other parts of HPCC. 



Supercomputer Technology 

The scalable massively parallel supercom- 
puter systems that HPCC is supporting must 
overcome very large obstacles before they can 
succeed commercially. As noted in Chapter 3, 
growth in the workstation market may pre- 
empt substantial growth in the supercom- 
puter market. If that occurs, firms may not be 
willing to make the large investments in prod- 
uct development necessary to bring massively 
parallel supercomputer systems to mark' c. If 
they do bring them to market, they may not 
sell enough of them to pay for those invest- 
ments. 

The supercomputer market is already oc- 
cupied by a successful incumbent, the vector 
supercomputer, sales of which have risen from 
$100 million to $1.5 billion over the last dec- 
ade. This incumbent is armed with a backlog 
of well-written, fine-tuned, ready-to-run soft- 
ware. Nor is it standing still; rather, it is ad- 
vancing in technology, even becoming more 
parallel, albeit at a less rapid pace than the 
massively parallel supercomputers. 

Dislodging incumbents in computer mar- 
kets is not easy. New entrants usually go 
around their competitors by introducing new 
capabilities or sizes or price levels. The mini- 
computer avoided direct competition with the 
mainframe computer, as the personal com- 
puter did with the minicomputer. Whether 
the additional speed provided by massively 



parallel processors on the limited number cf 
problems they are uniquely qualified to an- 
swer will provide a sufficient distinction in the 
marketplace is not yet clear. 



Network Technology 

Demand for computer communications, by 
contrast, is growing quite rapidly, and there is 
no dominant incumbent technology. Further, 
a large component of the federal effort in this 
area is addressed not so much to technology 
development as to institution building, an ar- 
ea in which the federal government has a com- 
parative advantage because it is perceived as 
a disinterested party. Although Internet has 
done much to push back the frontiers of tech- 
nology, its major achievement has been to cre- 
ate a network of individuals and organizations 
who have learned how to work together in 
maintaining lines of communication. But 
even though the field of data communications 
is growing rapidly, this growth will not nec- 
essarily translate into a demand for services 
providing the types of speed HPCC is designed 
to provide. 

The next arena for policy discussion is 
whether to begin a second phase of HPCC that 
would develop more applications for its net- 
work capability. Members of Congress and in- 
dustry have suggested developing and dem- 
onstrating such applications in areas as di- 
verse as education, medicine, and manufactur- 
ing. Legislation has been introduced that 
would authorize $1.0 to $1.6 billion over the 
next five years for this purpose. In some of the 
areas the federal program could build on, 
there is already substantial activity. In addi- 
tion, federal, state, and local governments al- 
ready play a substantial role in both education 
and medicine. 
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Supercomputer Component 
Technology Spinoffs 



This appendix describes major areas of 
computer technology and shows in 
each case how supercomputer technol- 
ogy requirements differ from the require- 
ments of the rapidly growing parts of the com- 
puter market. In general, it is these other 
parts of the market that are leading the devel- 
opment of technology. Table A-l outlines the 
areas of computer technology that are touched 
on and notes how the requirements of the 
supercomputer market differ from those of 
other computer markets. 

The word "technology" as used in this report 
means the ability to perform certain work at a 
given cost level: technology is defined in both 
technical and economic terms. That two com- 
puters or electronic components have the same 
capabilities or features does not mean they 
have the same technology. For example, in 
1973 the XEROX Palo Alto Research Center 
invented the ALTO computer, which had 
many of the features now commonly seen in a 
state-of-the-art personal computer, including 
graphical-user interfaces, networks, a point- 
ing device like the "mouse," and so forth. Al- 
though the technical features are the same, 
the technology of the computers is different: 
the XEROX machine would have cost $25,000, 
while the personal computer with these fea- 
tures now costs less than $1,000.! The compo- 
nents have changed, the software has 
changed, the way they work together has 
changed, and the way they are manufactured 
has changed. 



I. Robert Cringely, Accidental Empires (New York: 
Addison-Wealey Publishing Co., 1992), pp $3-84. 



Thus, it is not surprising when features that 
appeared first on supercomputers eventually 
appear elsewhere. When other computer mak- 
ers copy a popular feature, this is a response to 
perceived demand and not necessarily a spin- 
off of the same technology. In fact, the ability 
to provide the same feature in a more conve- 
nient package at lower cost is characteristic of 
technological advance. 



Integrated Circuits 

The largest advances in integrated circuits 
have been found in complementary metal - 
oxide-semiconductor (CMOS) technology. 2 
This type of integrated circuit permits low 
power usage with a high transistor count (or 
density) at relatively low cost, but it is rela- 
tively slow. Throughout the 1980s, most of the 
microprocessors and memory chips at the 
heart of the personal computer increasingly 
employed CMOS or its metal-oxide-semicon- 
ductor (MOS) relatives. The slowness of the 
chips did not matter to most personal com- 
puter or workstation buyers given the rela- 
tively low cost and high number of the compo- 
nents. (A higher transistor count allows an in- 
tegrated circuit to perform more tasks or re- 
tain more information in its memory.) 

By contrast, conventional supercomputer 
designers have had to work with emitter- 



2. For a simple if dated description of CMOS and other 
semiconductor devices, see James D. Meindl, "Microelec* 
tronic Circuit Elements," Scientific American (Septem- 
ber 1977), pp. 70-81. 
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Table A 1. 

Major Computer Technologies 





Integrated Circuits 
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Cooling 
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Software 


Supercomputers 


ECL 


Fast 


Relatively 
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Arrays 


Densely 
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Liquid 


Fast 


Unix 


Other Major 

Computer 

Markets 


CMOS 


Cheap 


Many 


RISC 


Less 
Densely 


Few 


Air 


Cheap 


Unix 
and 
Other 



SOURCE: Congressional Budget Office. 



NOTES: ECL = emitter-coupled logic; CMOS = complementary metal-oxide-semiconductor; RISC = reduced-instruction-set com- 
puting. 



coupled logic (ECL), a fundamentally different 
integrated circuit technology that, although it 
has fewer components and uses more power, is 
substantially faster. Since supercomputers 
are optimized for speed, they usually have not 
had the option of using the CMOS devices. 
Thus, the ECL markets and MOS markets 
have been relatively separate; even the pro- 
ducers of these different integrated circuits 
are not necessarily the same .3 

As the speed of workstations has increased, 
CMOS devices have proved too slow. The 
BiCMOS technology for integrated circuits 
was developed to meet the need for dense but 
fast components. This technology is much 
faster than the conventional CMOS, but still 
has quite a high transistor count. The engi- 
neering workstation market has been the pri- 
mary driver of the development of this tech- 
nology. 4 Now both mainframe and supercom- 
puter producers are looking at BiCMOS tech- 
nology, especially in memory, for their next 
generation of computers. 5 In this sense, 



supercomputer technology is beginning to 
benefit from the technology developed for the 
ubiquitous and inexpensive personal com- 
puter and its more expensive cousin, the en- 
gineering workstation. 

Within their market segment, however, su- 
percomputer designers have improved or been 
among the first to adopt new ECL technology 
as it became available, and thus have influ- 
enced mainframe computer technology, often 
by pushing their vendors. For instance, Cray 
Research bought its ECL gate arrays from 
vendors and pushed them to increase the com- 
plexity of the metal layers and to increase the 
number of layers from three to four. 6 The ven- 
dors subsequently made these improvements 
available to other ECL clients, primarily in 
mainframe computers. Before its current gen- 
eration of supercomputers, however, Cray Re- 
search mainly bought its integrated circuits as 
off-the-shelf components, preferring to con- 
centrate its research and development efforts 
on novel packaging and interconnections. 



3. See Harold Dozier, "Superchipa for Supercomputing," 
IEEE Spectrum (September 1992), pp. 66-68. 

4. Occasionally, a >S workstation microprocessor de- 
sign will be implemented in ECL technology, but such 
implementations are not driving the technology of work- 
station microprocessors. 



6. 



David Patterson, "Expert Opinion: Traditional Main* 
frames and Supercomputers Are Losing the Battle," 
IEEE Spectrum (January 1992), p. 34. 

A gate array is a kind of semicustom integrated circuit 
composed of a matrix of logic gates (or switches). The 
layers of metal connecting these gates give each inte- 
grated circuit its unique electronic character. 

7(J 
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Computer Architecture 

The other major innovation in computer tech- 
nology of the last decade was reduced-instruc- 
tion-set computer (RISC) architecture, which 
is at the heart of contemporary workstations 
and allows them great speed despite the use of 
CMOS components. Most mainframe and per- 
sonal computers, by contrast, still use com- 
plex-instruction-set computer (CISC) architec- 
ture. 

The central difference between the two 
types of architecture is in the number and 
types of instructions a computer understands. 
A RISC machine understands relatively fewer 
instructions, but executes them rapidly. A 
CISC computer has a larger vocabulary with 
more complex instructions, but executes them 
more slowly. 

The insight that led to RISC is that most 
computer tasks actuelly involve a relatively 
small number of operations, such as adding 
two numbers, so it is advantageous to be able 
to perform these common operations rapidly, 
rather than to be able to perform a wider array 
of operations more slowly. By way of compari- 
son, when RISC was first introduced, the ma- 
jor CISC families were capable of performing 
between 200 and 300 instructions, while the 
early RISC computers had only between 40 
and 120 instructions. 7 

IBM first started work on RISC architecture 
in the 1970s, and other research was under- 
taken at Berkeley and Stanford, although the 
latter two projects were unaware of the IBM 
efforts.* RISC architecture became wide- 
spread as the price of computer memory fell 
dramatically throughout the 1980s. (RISC 



7. David A. Patterson, "Reduced Instructions Set Computr 
en/ Communications of the ACM [Association of Com- 
puting Machinery] (January 1985). pp. £-21. 

8. David Patterson and John Hennesay, Computer Archi- 
tecture: A Quantitative Approach (San Mateo. Calif.: 
Morgan Kaufmann Publishers, 1990). pp. 189-191. For 
the IBM contribution, see Ronald Jurgen. "John Cooke: 
Vision with Enthusiasm," tEEE Spectrum (December 
1991). pp. 33-34. 



software programs, because they are composed 
of many simple instructions, typically take up 
more memory than equivalent programs de- 
signed for CISC.) While many supercom- 
puters have had elements of RISC--mainly a 
simplified instruction set-in them since the 
1960s, supercomputers did not lead in RISC 
design. The engineering workstation, which 
is the major market for RISC, was the primary 
force behind software and hardware develop- 
ment in this market. 

As RISC architecture first developed in 
microprocessors for engineering workstations, 
designers copied features from existing main- 
frame and supercomputer designs. The high- 
performance features most commonly copied 
included pipelining, which, as discussed in 
Chapter 3, involves creating an assembly line 
of instructions, and cache memory, which 
functions as a clipboard for frequently used 
items in the computer memory and gives fast 
access to these items. 

However, as CMOS integrated circuit tech- 
nology progressed, RISC designers were able 
to advance the use of these features very ag- 
gressively. According to John Hennessy, one 
of the original RISC designers, "a number of 
[RISC] microprocessor-based machines have 
used pipelining and cache techniques that are 
more advance 2 than those in use in the big- 
gest machines." 9 The ease of redesigning 
large-scale integrated circuits, relative to re- 
designing conventional central processing 
units, encouraged rapid development of RISC 
architecture. Thus, although RISC architec- 
ture inherited much of its technology from ex- 
isting high-performance computers, it moved 
at a much faster pace and soon began advanc- 
ing technology on its own. 

The Defense Department's Advanced Re- 
search Projects Agency (ARPA) paid for much 
of the early R&D on RISC at Berkeley and 
Stanford as part of its work on very-large- 



9. John Hennessy and Norman Jouppi, "Computer Tech- 
nology and Architecture: An Evolving Interaction." 
Computer (September 1991), p. 22. 
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scale integrated circuits in the late 1970s. 1( > 
ARPA also paid for much of the early R&D in- 
volved in developing the first engineering 
workstation and funded much of the early 
R&D in massively parallel supercomputers. 
This juncture is no coir> / " dence: ARPA was 
funding several different avenues of research 
to achieve the same goal-faster computers. In 
the words of one technology analysis, 

Where RISC architects sought to 
achieve efficiencies by incorporating 
within microprocessor structure the 
best possible juxtapositions of cache 
memory, registers, message routers, 
and logic units so that they would in- 
teract in the most efficient way, par- 
allel architects sought to use separate 
processors in communication (intercon- 
nect) structures that would achieve 
those kinds of efficiencies.il 

Having grown primarily in workstation de- 
sign, RISC architecture is now moving to oth- 
er areas of the computer market. Mainframe 
producers have announced their interest in 
such architecture. In addition, the next gen- 
eration of IBM-compatible personal computers 
is likely be powered by an Intel microprocessor 
(the Pentium) that contains elements of RISC 
architecture. Lastly, many, if not most, of the 
massively parallel supercomputers are based 
on RISC microprocessors originally developed 
for workstations. As noted in the main text, 
much, if not most, of the improvement in the 
performance of massively parallel supercom- 
puters during the last decade can be attrib- 
uted to the use of ever more sophisticated 
workstation RISC microprocessors. 12 



10. Richard Van Atta, Sidney Reed, and Seymour Dutch- 
man, "DARPA Technical Accomplishments; A Historical 
Review of Selected DARPA Projects/ 1 Volume II (Alex- 
andria, Va.: Institute for Defense Analysis, February 
1990), pp. 17-A-l through 17-A-4. Chapter 17 and its ap- 
pendixes concentrates on DARPA's efforts in integrated 
circuit and computer design technology in the later 
1970s and early 1980s. 

11. Ibid., p. 17-23. 

12. For this history of improvement, see John Van Zandt, 
Parallel Processing in Information Systems (New York: 
John Wiley and Sons, 1992). 



A growing number of workstations and 
even high-end personal computers use more 
than one microprocessor, in a trend reminis- 
cent of but independent from the development 
of massively parallel supercomputers.13 Sun 
Microsystems, Silicon Graphics, and others al- 
ready make or have announced products con- 
taining more than one processor. Thus, while 
supercomputer technology is advancing by 
linking massive numbers of microprocessors, 
workstation technology is similarly advancing 
by linking small numbers of the same RISC 
microprocessors. Because manufacturers of 
vector supercomputers have had substantial 
experience with multiprocessors, computer de- 
signers are likely to have drawn on that exper- 
ience in producing multiprocessor worksta- 
tions. 14 



Printed Circuit Boards 
and Other Packaging 

Supercomputer producers have confronted 
problems in the area of printed circuit boards 
well ahead of other producers of electronics 
equipment. In order to make the supercom- 
puters run faster, producers have placed the 
electronic components close together and have 
had to design sophisticated multilayer boards 
to accommodate them.* 5 The fast components 
used by supercomputers put out more elec- 



13. Norris Parker Smith, "Workstations and Supercom- 
puters " Supercomputing Review (January 1992), pp. 50- 
51. 

14. For a history of multiprocessing in workstations, see 
Patterson and Hennessy, Computer Architecture, p. 
588ff. 

15. Supercomputer Systems, an IBM-backed Cray spinoff, 
announced that the printed circuit board for its forth- 
coming supercomputer would have 78 layers. Terry 
Costlow, "SSI Supercomputer to Use Superboards " Elec- 
tronic Engineering Times (July 20, 1992), pp. 1 and 64. 
(Since this announcement, the company has had to close 
for reasons unrelated to its circuit boards.) By contrast, 
one printed circuit board for the next generation micro- 
processor for IBM-compatible personal computers will 
have only six layers. Rick Boyd-Merritt and Alan Pat- 
terson, "Asians [personal computer producers] Get 
Chance to Plug in Pentium," Electronic Engineering 
Times (January 4, 1993), p. €0. 
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tronic noise than slower, low-power devices; 
consequently, the supercomputer designers 
have become expert at isolating both the in- 
tegrated circuits and the circuits that connect 
them, using special materials and other so- 
phisticated techniques. 

As conventional electronic equipment 
grows in sophistication, its producers will con- 
front many of the same problems. For in- 
stance, as workstation microprocessors be- 
come faster, they outrun the electronic signal 
speeds that can be transmitted easily through 
conventional printed circuit boards. Conse- 
quently, some have begun to turn to multi- 
chip modules, where the central processing 
unit (or microprocessor) and several periph- 
eral chips are contained within specially de- 
signed modules. 16 Vendors who have had to 
supply supercomputer producers may find 
some of their expertise applicable in these new 
areas. 

Because supercomputers were designed to 
use large numbers of relatively simple and hot 
integrated circuits, their producers have con- 
fronted problems of packaging and heat dissi- 
pation long before most other computer pro- 
ducers have. Although most computers can be 
cooled by air and fans, supercomputers often 
need water and refrigerant systems. 17 As oth- 
er computers increase their component count 
and speed they will confront the same package 
density and cooling problems that supercom- 
puter producers have for years. 

However, conventional computer producers 
will be constrained in ways that supercomput- 
er producers are not. For example, worksta- 
tion makers will want to retain the small size 
and relative portability of their systems. Giv- 
en these constraints, it is not clear how much 
of the unique supercomputer packaging and 
cooling technology will migrate to the work- 



16. Philip Koopman, Jr. and Daniel Siewiorek. M tCs: The 
Brains of a Workstation," IEEE Spectrum (April 1992\ 
pp. 52-53. 

17. In fact, so much waste heat is generated that it can be 
used for other purposes. Supercomputer waste heat in 
sometimes used to heat buildings. 



station or personal computer markets. Again, 
the mainframe computer market seems posi- 
tioned as the most likely beneficiary. 



Computer Disks 

In the past, supercomputers have been at the 
forefront in many aspects of magnetic disk 
storage technology. Specifically, they have de- 
manded ever-increasing speed from suppliers 
of hard disk drives. This has meant faster 
read/write heads, multiple platters, and mul- 
tiple spindles, all of which have the potential 
to be carried over to the general computer 
market. 

However, as with microprocessors, the 
needs of the more numerous desktop systems 
have dominated the industry. The small sys- 
tems have emphasized the achievement of size 
and price goals rather than absolute perfor- 
mance. In fact, parallel with the use of large 
numbers of inexpensive microprocessors to 
create a supercomputer, computer designers 
have now begun to provide redundant arrays 
of inexpensive disk (RAID) subsystems as an 
alternative to the larger disk drives used by 
most mainframe and supercomputer produc- 
ers. 18 Arrays of disks have been available on 
smaller systems and are beginning to migrate 
to mainframes. ARPA funded some of the ear- 
ly R&D in this area. 



Supercomputer Software 

At present, the vector supercomputers and 
minisupercomputers made in the United 
States largely use the same UNIX operating 
software as the engineering and technical 
computers. This is the same software that 
runs on the engineering workstations that 



18. Terry Costlow, "RAIDs are Underway Electronic En- 
gineering Times (January 6, 1992), pp. 1 and 50. 
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dominate the design and technical uses. 
UNIX is as ubiquitous in that world as the 
IBM-originated operating systems (DOS, 
MVS) are in the world of business and finance. 
For example, since the mid-1980s, Cray Re- 
search has used UNICOS, a Cray version of 
UNIX. Because it is a version of UNIX, 
UNICOS can run many UNIX programs, 
which makes using these supercomputers sim- 
pler for those who are already familiar with 
UNIXsoftware.19 



19. Cray Research. '"Directory of Applications Software for 
Cray Research Supercomputers" (Mendota Heights, 
Minn., January 1990). 



Much of the software originally developed 
for supercomputers has found its way into the 
workstation market. The scientific visualiza- 
tion of it originated in supercomputer applica- 
tions and only in recent years, as workstations 
have increased in power, has the software be- 
gun to migrate. Many of the numerical analy- 
sis applications have similarly migrated from 
supercomputers to workstations. 
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Appendix B 

Supercomputer Speed Calculations 



This appendix discusses the assump- 
tions and calculations underlying the 
comparison of vector supercomputer 
speed with massively parallel supercomputer 
speed. The Congressional Budget Office 
(CBO) replicated the calculations of Peter 
Gregory in "Will MPP [Massively Parallel 
Processing] Always be Specialized?" which 
appeared in the March 1992 edition of Super- 
computing Review. 1 

The simulations are based on Amdahl's Law 
and published estimates of the speed of compo- 
nents of different supercomputers, not on ac- 
tual performance. Amdahl's law states that 
"the performance improvement to be gained 
from using some faster mode of execution is 
limited by the fraction of the time the faster 
mode can be used." 2 In other words, the 
speedup attributable to the use of a massively 
parallel processor will be limited by the per- 
centage of a problem that can use parallel cal- 
culations. 

The formula used to construct Figure 3 on 
page 27 was the following: 

P= 3 

(1-FP)+(FP/N) 

where 

P is computer performance (in millions of 
floating point operations per second), 



1. See pp. 28-31. 

2. David Patterson and John Hennessy, Computer Archi- 
tecture: A Quantitative Approach (San Mateo, Calif.: 
Morgan Kaufmann Publisher!, 1990), p. 8. 



S is the speed of the individual processor (in 
millions of floating point operations per sec- 
ond), 

FP is the fraction of operations that can be 
performed in parallel, and 

N is the number of processors. 

Numerical problems presented to supercom- 
puters for solution typically have two types of 
processes: scalar operations, which involve 
single numbers, and vector operations, which 
involve strings of numbers. Each processor 
has a different speed for each type of opera- 
tion. Each problem has a unique combination 
of scalar and vector operations. Thus, the for- 
mula was used to create polar cases, where 
problems were 100 percent vector and 100 per- 
cent scalar. Actual performance will lie be- 
tween. Either way, except for instances where 
problems permitted parallel calculations that 
were almost entirely parallel, the vector su- 
percomputer outperformed the massively par- 
allel supercomputer. For purposes of expo- 
sitional simplicity, CBO only presented the 
vector calculations. The addition of scalar per- 
formance would not substantially change the 
conclusions. In only one of the existing com- 
puters did inclusion of scalar performance 
shift the crossover point by more than 1 per- 
centage point, and there it only served to re- 
inforce the advantage of vector supercom- 
puters. 

The computers Peter Gregory chose for com- 
parison were the Cray Research Y-MP C90, 
Thinking Machines CM-5, and the Intel Para- 
gon. These machines are the premier ma- 
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chines of three leading supercomputer produc- 
ers. The assumptions about their speeds (in 
millions of floating point operations per sec- 
ond) and processor counts are shown below: 



Computer 


Scalar 


Vector 


Processor 


Speed 


Speed 


Count 


Y-MPC90 


29 


1,000 


16 


CM-5 


4 


128 


1,000 


Paragon 


7 


75 


2,048 



When CBO performed sensitivity tests, 
even doubling the scalar speeds of the mas- 
sively parallel supercomputers did not sub- 
stantially alter the central conclusion. The 



vector performance is based on published peak 
speed. 

The variable FP is defined as the percent- 
age of operations that can be performed in par- 
allel over the entire application. It assumes 
that parallel means that the entire number of 
processors of each machine will be used. This 
assumption is more favorable to the massively 
parallel supercomputer as it is easier to find 
problems that are divisible 16 ways than 
1,000 or 2,000 ways. It also assumes instanta- 
neous communication between nodes, an as- 
sumption that again favors the massively par- 
allel supercomputer, since it has more nodes. 
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Network Speed Calculations 



This appendix discuses the assumptions 
and calculations underlying the dis- 
cussion of computer network response 
time. 1 The calculation of computer network 
response time is based on the following for- 
mula: 

T = (F/C2+D 
(1-p) 

where 

T is response time (in milliseconds), 

F is the average file size on a network (in 
1,000 bits), 

C is the network capacity (in million bits 
per second), 

p is capacity utilization (in percentage of to- 
tal capacity), and 



D is propagation delay because of the 
amount of time it takes light signals to trav- 
el between locations. 

Unlike Kleinrock, the Congressional Bud- 
get Office does not assume that light travels at 
the same speed in a fiber optic cable as in a 
vacuum. Light travels through fiber at 
roughly two-thirds the speed it travels 
through interstellar space. Consequently, 
CBO assumes that it takes roughly 10.5 mil- 
liseconds for a light signal to propagate 
through a fiber halfway across the continental 
United States. Kleinrock assumed it would 
travel across the continental United States in 
15 milliseconds. 

CBO assumed that the average size of files 
on the computer network was 1,000,000 bits, 
roughly the size of a FAX. 2 



1. The discussion is baaed largely on Leonard Kleinrock, 
"The Latency/Bandwidth Tradeoff in Gigabit Networks," 
IEEE Communications Magazine ^April 1992 J, pp. 36-40. 



2. Lawrence Roberts, "Gigabit Networks: Emerging Com- 
mercial Applications & Opportunities" (presentation at 
the 1992 conference of the Technology Transfer Insti- 
tute. Santa Monica, Calif., July 8-29, 1992). 



0 



CONGRESSIONAL 
BUDGET OFFICE 
Second and D Streets, S.W. 
Washington, O.C. 20515 



OFFICIAL BUSINESS 

PENALTY FOR PRIVATE USE. $300 



FIRST-CLASS MAIL 
POSTAGE & FEES PAID 
C.B.O. 
WASHINGTON, D.C. 
PERMIT No. G-70 



ISBN 0-16-041828-3 




ERIC 



73 



